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benefits provided by technology resources are essential. An analytic form of analysis 
known as the Knowledge Value Added (KVA) methodology will be used in this thesis to 
capture and quantify the benefits of the ship maintenance and modernization 
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A proof of concept case was developed to analyze current maintenance and 
modernization efforts for combatant ships of the Navy’s surface forces. Using the current 
status as a baseline analysis, the KVA methodology is applied to a notional scenario 
which uses 3D laser scanning and Product Lifecycle Management to reengineer the 
current process. The notional scenario demonstrates positive returns from the 
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I. INTRODUCTION 


A. BACKGROUND 


This thesis builds upon previous research by Lieutenant (LT) Christine 
Komorosky, USN, utilizing the Knowledge Value Added/Real Options (KVA+RO)! 
valuation framework to evaluate the effects of 3-Dimensional (3D) terrestrial laser 
scanning technology and Product Lifecycle Management (PLM) technologies in the four 
public sector naval planning yards. LT Komorosky’s research demonstrated that by 
adding 3D terrestrial laser scanning tools and PLM technologies to the planning yards 
core processes, the total process cost decreased by 89 percent (2006). Studies conducted 
by the Naval Shipbuilding Research Program (NSRP) found that adding 3D terrestrial 
laser scanning tools to just the ship check process? decreased cost by as much as 44 
percent and cycle time by 49 percent (2006). Additionally, a follow-on NSRP study 
found that the technology is beyond the early adoption phase and is mature enough to be 


used reliably (2007). 


The maintenance of Department of Defense (DoD) assets is big business. In 
Fiscal Year (FY) 2005, more than $81 billion was spent to support approximately 280 
ships, 14,000 aircraft 900 strategic missiles and 330,000 ground combat and tactical 
vehicles (Office of the Deputy Under Secretary of Defense (Logistics and Material 
Readiness), 2006). That is an increase of nearly 28 percent from FY 2003 expenses of 
$59 billion. Given the high cost of maintenance activities and the substantial annual 
increase in budget, it appears that the nation’s leaders are committed to maintaining a 


high level of operational readiness within the DoD. 


1 See Appendix A for a detailed discussion of the KVA+RO framework. 
2 Ship check is one of seven core processes of the planning yard (Komorosky, 2005, p. 32). 


1 





DOD Maintenance Spending in Billions 














FY2003 FY2004 FY2005 











Figure 1. DoD Maintenance Expenses 


The U.S. Navy is transitioning into a new era of maintenance on its entire fleet of 
surface ships, submarines and aircraft within the structure of the Fleet Modernization 
Plan (FMP). The Navy spent approximately $39.1 billion in FY 2006 (including all 
wartime supplemental funding) to operate, maintain and modernize its 4,000 plus aircraft 
and 276 deployable battlse force ships (Office of the Deputy Under Secretary of Defense 
(Logistics and Material Readiness), 2006, p. 3). In order to meet the United States’ 
national defense objectives within cost, schedule and performance constraints, new 
business processes coupled with innovative use of technologies like 3D terrestrial laser 
scanning and PLM are required to provide for maintenance, modernization, and repair of 


the Navy’s battle force assets. 


The current acquisition environment in the DoD and the Navy is moving toward 
new and innovative ways of getting the most return possible for each dollar spent. 
Initiatives like Open Architecture (OA), the Entitled Process for Surface Ship and Carrier 
modernization (SHIPMAIN EP) and rapid acquisition strategies are challenging old 
business models to get higher levels of mission capability for less cost in less time. Cost 
estimation and comprehensive lifecycle management are two specific areas that the Navy 
needs to become more efficient in to enable these new initiatives. PLM management 


techniques and technologies have the potential to provide DoD leaders the ability to: 


e Minimize lifecycle expenses and up front cost overruns from poor cost 
estimation. 

e Ensure a comprehensive lifecycle portfolio exists for each program of 
record and specific units of each program (i.e. specific hulls of each ship 
class). 


e Have a means to evaluate total cost of ownership and hold Program 
Managers (PM) accountable for their efforts to evaluate lifecycle costs, 
not just up front cost, in meeting program cost objectives. 


B. RESEARCH OBJECTIVES 


Given the remarkable findings of previous research, this study will expand the 
scope of LT Komorosky’s work and map her proof of concept case study using 3D 
terrestrial laser scanning and PLM technologies to specific phases of the ship 
maintenance and modernization (SHIPMAIN) process?. Findings from LT Komorosky’s 
research will be applied to the SHIPMAIN process, with appropriate conditional 
modifications, and the potential cost-savings and reduction in cycle time will be 
evaluated. An as-is analysis will include the SHIPMAIN process as defined in current 
directives and once reliable Knowledge Value Added (KVA) estimates are obtained, the 
process will be reexamined factoring in the capabilities of 3D terrestrial laser scanning 


and PLM technologies for a to-be model. 
C; RESEARCH QUESTIONS 


To determine potential outcomes from acquiring and using 3D terrestrial laser 
scanners and collaborative PLM tools in a SHIPMAIN environment, the following 
questions will be answered: 


® Will 3D terrestrial laser scanning and PLM technologies provide better 
ROI for the Navy in the SHIPMAIN environment of the Fleet 
Modernization Plan than are currently being realized? 


e What are the other potential uses of the two technologies in such processes 
as ship maintenance, modernization and repair? 


Previous research demonstrated promising results through qualitative evidence derived 
from the use of KVA methodology to assess the impact of Information Technology (IT) 
systems, specifically 3D terrestrial laser scanners and collaborative PLM technologies, in 


the legacy planning yard processes. 


3 SHIPMAIN refers to maintenance and modernization efforts, SHIPMAIN EP refers to modernization 
efforts only (Anonymous, personal communication, May 2007). 
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D. METHODOLOGY 


This thesis will model phases IV and V of the current SHIPMAIN process and 
predict outcomes from a reengineered process model that incorporates 3D terrestrial laser 
scanning and PLM technologies. Komorosky’s proof of concept case study will be 
mapped directly to applicable areas of SHIPMAIN and the quantitative results of the 
KVA methodology will be applied to similar processes. For areas of SHIPMAIN phases 
IV and V not covered by Komorosky’s research, the KVA methodology will be applied 
to measure the impact that 3D laser scanning and PLM technologies will have on the 
current process model. First, all major inputs, processes, and respective outputs will be 
identified by a comprehensive review of current SHIPMAIN directives. This model will 
then be validated by SHIPMAIN subject matter experts (SME). The sub-process analysis 
will include estimates for the time to learn each process, the number of personnel 
involved, and the number of times each process is executed. Market comparable values 


will be used to help estimate cost figures and add value to the methodology. 


E. SCOPE 


The intended scope of this thesis is addressing the Knowledge Value Added, and 
potential benefits, or return on investment (ROD), that 3D terrestrial laser scanning and 
PLM technologies bring to the SHIPMAIN process. The SHIPMAIN process is a large 
program with many interrelated concepts, instructions, policies, and specializations for 
study. Ideally, this research would provide a comprehensive analysis of the entire 
SHIPMAIN process from phase I through all decision points and acquisition milestones 
to the final steps of phase V. The technologies evaluated in this research are likely to 
provide additional benefits (e.g. more accurate cost estimation, higher quality, less 
rework and more efficient system dynamics) across all phases of SHIPMAIN. However, 
the quantitative scope of this research will be constrained to phases IV and V of the 
SHIPMAIN process. Readers of this research should bear in mind that any benefits or 
ROI demonstrated in this thesis only begin to scratch the surface of the potential these 


technologies have to offer. 


F. ORGANIZATION OF THESIS 


Chapter I will include an overview of this research and will identify the primary 
objectives and questions of focus. The methodology used to reach conclusions and make 
recommendations is also described. Chapter II contains a literature review to introduce 
relevant concepts. It will provide a brief discussion on the overall missions of the FMP 
and SHIPMAIN, 3D terrestrial laser scanning and PLM technologies, and Lean/Six 
Sigma (L6S) methodology supported by KVA. In the third chapter, more detailed 
discussion of previous research by LT Christine Komorosky will occur and the results 
will be mapped to specific areas of SHIPMAIN for direct application of the KVA 
methodology. Areas of SHIPMAIN that LT Komorosky’s research does not map directly 
to will be identified. Chapter IV will begin with a brief discussion of the KVA valuation 
framework along with underlying assumptions. It will continue by applying the KVA 
methodology to specific areas of the SHIPMAIN environment, identified in chapter III. 
A case study applying the KVA methodology comprehensively across phases IV and V 
of SHIPMAIN will analyze the potential impact of 3D terrestrial laser scanning 
technology and collaborative PLM solutions under two scenarios: current as-is and 
potential to-be. The final chapter will conclude with specific recommendations and 


conclusions. 
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I. LITERATURE REVIEW 


A. THE FLEET MODERNIZATION PLAN 


Keeping a fleet of 276 deployable ships and more than 4,000 aircraft in an 
acceptable operational condition while modernizing and acquiring new vessels is a 
difficult task to accomplish within fiscal constraints. In response to this challenge, the 
U.S. Navy established the FMP* to: 

..._provide a disciplined process that delivers operational and technical 

modifications to the Fleet in the most operationally effective and cost 

efficient way. The FMP defines a standard methodology to plan, budget, 

engineer, and install timely, effective, and affordable shipboard 

improvements while maintaining configuration management and 


supportability — (Commander, Naval Sea Systems Command, 2002, p. 1- 
Ly: 


The FMP is the means by which the Navy leverages technology and innovation 
to: 


e Keep the war-fighting edge. 


e Fix systemic and safety problems. 

e Improve Battle Force Interoperability. 

e Improve platform reliability and maintainability. 

° Reduce the burden on the sailor (Commander, Naval Sea Systems 


Command, 2002, p. 1-1). 


The FMP process is designed to prevent unauthorized and non-supported 


alterations from being installed on ships. 


Unauthorized alterations represent a substantial cost to the Navy in terms 
of the loss of configuration control, inefficiencies due to unexpected 
installation interference, systems and equipment which are not logistically 
supported, and resources expended to support items which are no longer 


4 “Chief of Naval Operations (OPNAV) N43 sponsors the FMP and Naval Sea Systems Command 
(NAVSEA) 04M3 serves as the FMP Policy Implementation Office and Program Manager for the Navy 
Data Environment-Navy Modernization (NDE-NM) database (formerly the Fleet Modernization Program 
Management Information System (FMPMIS) which is the official database in support of the FMP” 
(Commander, Naval Sea Systems Command, 2002, p. 1-1). 


q 


required. Unauthorized and unsupported alterations adversely impact the 
interoperability of highly computerized and integrated combat systems. 
This equates to a loss of combat effectiveness due to a reduction in Carrier 
Strike Group/Expeditionary Strike Group interoperability and individual 
ship capabilities — (Commander, Naval Sea Systems Command, 2002, p. 
1-1). 


B. THE SHIPMAIN PROCESS 


The Navy’s Sea Power 21 vision outlines what capabilities naval forces will 
provide the nation in the decades ahead. In that vision, Sea Enterprise is transforming the 
way the Navy does business by harvesting efficient ways of getting jobs done, saving 
resources, reinvesting them into future Navy assets and delivering increased combat 
capability. SHIPMAIN is one of the newest initiatives aimed at harvesting efficient ways 
to get the job done. It is a best business practice that fleet sailors and shipyards are 


utilizing, changing the culture of getting ship work completed. 


Beginning in FY 2004, the Navy implemented the SHIPMAIN process to provide 
a disciplined means to: 


e Increase the efficiency of the maintenance and modernization process 
without compromising their effectiveness. 


e Define a common planning process for surface ship maintenance and 
alterations. 

e Install a disciplined management process with objective measurements. 

e Institutionalize the process and a continuous improvement methodology 


for it (Commander, Naval Sea Systems Command, 2006). 


The initiative seeks to identify redundancies in maintenance processes and 
eliminate them. SHIPMAIN is about doing the right maintenance at the right time, in the 
right place for the right cost. It provides a single process that will assist the Navy in 
realizing the maximum benefit per maintenance dollar by eliminating time lags, 
prioritizing ship jobs and empowering Sailors in their maintenance decisions 


(Commander, Naval Sea Systems Command, 2006) 


In August of 2006, the Surface Ship and Carrier Entitled Process for 
Modernization (SSCEPM) Management and Operations Manual, also known as “The 


One Book,” became the Navy’s official document for the modernization of all Surface 
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Ships and Aircraft Carriers (Commander, Naval Sea Systems Command, 2006). It 
provides the policy and processes associated with SHIPMAIN for planning, budgeting, 
engineering and installing timely effective and affordable shipboard improvements while 
maintaining configuration management and supportability. The SHIPMAIN process 
represents a sweeping change in the modernization of Surface Ships and Carriers. It 
significantly reduces the FMP by reducing over 40 change types to just two. 
Additionally, the SHIPMAIN process streamlines and consolidates a number of existing 
modernization practices, processes, meetings and supporting documents to provide a 


single hierarchical decision making process for modernizing Surface Ships and Carriers. 


The SHIPMAIN process is comprised of five distinct phases° and three Decision 
Points (DP)® to take a proposed change from concept to completion in one document, the 


Ship Change Document (SCD). 


The intention of the SCD is to be a single lifecycle management document 
depicting a modernization change from concept to completion for 
individual or multiple classes of ships. This single universal streamlined 
process enables complete documentation of a proposed change and 
provides a comprehensive review and decision capability with results 
being reflected in a Navy Modernization Plan (MP). The process begins 
with the initiation of a SCD and concludes with an update of the ship’s 
configuration, Integrated Logistics Support (ILS), and Configuration 
Management (CM) records based on actual installations — (Commander, 
Naval Sea Systems Command, 2006, §3, p. 3-2). 


Appendix B provides a detailed description of each of the five phases. 


Although SHIPMAIN has a functional governance structure and supporting 
business rules, it has yet to reach a fully implemented state, especially in phases IV and 


V. 


The EP is currently functional through DP 3 from a Navy Data 
Environment (NDE) perspective. Once a Ship Change (SC) has been 
approved at DP 3, the submitter will follow existing legacy procedures, 
unless otherwise documented herein for interim procedures, until such a 





5 Five Phases: I-Conceptual, II-Preliminary Design, III-Detailed Design, [V-Implementation, V- 
Installation (Commander, Naval Sea Systems Command, 2006). 


6 DPs occur at the conclusion of Phases I-III. Each DP is an approval for funding of successive phases 
and has an associated Cost Benefit Analysis (CBA), Alteration Figure of Merit (AFOM) and 
Recommended Change Package (RCP) (Commander, Naval Sea Systems Command, 2006). 
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time as NDE can be modified for full implementation — (Commander, 
Naval Sea Systems Command, 2006, §3, p. 3-1). 


The business rules for phases IV and V are in a maturing phase and the process owners 
are regularly gathering input from stakeholders to resolve issues and refine the business 


rules in order to move forward with this initiative. 
Cc. TERRESTRIAL LASER SCANNING TECHNOLOGY 


The market for 3D terrestrial laser scanning is attracting substantial numbers of 
mainstream users. Sales of terrestrial 3D laser scanning hardware, software and services 
reached $253 million in 2006, a growth of 43 percent over 2005 (Greaves and Jenkins, 
2007). According to a 2007 report by SparView: 


laser scanner manufacturers and related software and service providers 
report strong activity across many markets including: shipbuilding, 
offshore construction and repair, onshore oil and gas, fossil and nuclear 
power, civil and transportation infrastructure, building, automotive and 
construction equipment manufacturing and forensics. The rapid growth of 
this market across diverse sectors of industry is a strong indicator of its 
transition to mainstream adoption — (Greaves and Jenkins, 2007, { 1). 
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Figure 2. 3D Laser Scanning Market (Greaves and Jenkins, 2007) 


Several manufacturers produce a variety of laser scanning models and capture 


technologies. Previous research by LT Komorosky (2005) evaluated Spatial Integrated 
10 


System’s (SIS) 3D Imaging System (3DIS) model. The 3DIS model provides macro 
scanning capabilities and an additional unit, the VZX, can be purchased if a micro 
capture is required. The 3DIS comes with two software tools which provide for the 
collection, initial point cloud processing and viewing of point clouds. According to an 
SIS representative, the current 3DIS scanner captures images in 1/5 the time of previous 
versions evaluated by LT Komorosky (B. Tilton, personal communication, May 16, 
2007). SIS also provides additional software tools as a value added reseller for UGS to 
conduct point cloud analysis, assembly processing and Product Lifecycle Management. 
Research by NSRP (2006 & 2007) evaluated products from Faro, Leica, Z+F, Visilmage 


and 3Dguru. Figure 3 shows the percentage of market share by manufacturer. 


Terrestrial 3D Laser Scanner Market Share Estimate 2004 
{Total $44.8 Million) 
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Figure 3. 2004 Market Share Estimate (Jenkins, 2005) 


Most manufacturers’ scanners work by scanning a target space with a laser light 
mounted on a highly articulating mount enabling data capture in virtually any orientation 
with minimal operator input. Some manufacturers also incorporate a digital camera that 
simultaneously captures a 360 degree field-of-view color photograph image of the target. 
Once the capture phase is complete, they automatically execute proprietary point 


processing algorithms to process the captured image. The systems can generate an 
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accurate’ digital 3D model of the target space, automatically fuse image texture onto 3D 
model geometry, export file formats ready for commercial high-end design and import 


into 2D and 3D Computer Aided Design (CAD) packages. 
D. PRODUCT LIFECYCLE MANAGEMENT TECHNOLOGY 


CIMdata8 defines PLM as: 


a strategic business approach that applies a consistent set of business 
solutions in support of the collaborative creation, management, 
dissemination, and use of product definition information across the 
extended enterprise from concept to end of life; integrating people, 
processes, and information — (2007a, {| 1). PLM is not a definition of a 
piece, or pieces, of technology but rather a business approach enabling 
longitudinal management of product definition information. PLM can 
create product definition information, manage it through its life and 
disseminate it throughout the lifecycle of the product. PLM is a strategic 
management approach in which processes are as important, or more 
important, than data — (2007a, {| 2) 


There are many valuable aspects to a PLM solution, one of which is the opportunity to 
improve the quality of products and processes, a similar goal of Lean/Six Sigma (L6S) 
processes. The complimentary role PLM tools provide to a business transformation using 


L6S will be explored later in this chapter. 


Figure 4 shows the impressive growth of the PLM market. CIMdata research 
indicates that the overall PLM market grew 10.4% to reach $20.1 billion in 2006 (2007b). 
CIMdata attributes this strong growth rate to continued recognition of the value of PLM 
in improving companies’ business performance. PLM investments are forecast to 
continue their climb over the next five years, increasing at a compound annual growth 


rate of approximately 8.5% to exceed an estimated $30 billion by 2011. 


7 NSRP’s study (2006 & 2007) requirement was within 3/16 of an inch to actual measurements. 


8 CIMdata is a consulting firm with over 20 years of experience in strategic IT applications and is an 
acknowledged leader in the application of PLM and related technologies (CIMdata, 2007a) 
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Figure 4. PLM Market Growth History and Forecast (CIMdata, 2007b)? 


Each year, PLM-related technologies and services are provided by more 


companies representing all sectors of the PLM industry. In 2006, six companies reported 


revenues of more than $1 billion as demonstrated in Figure 5. Some companies are 


focused on specific technologies and functions that are part of an overall PLM 


environment while others are distinguishing themselves as “PLM Mindshare Leaders!0” 


(CIMdata, 2007b, { 17). PLM Mindshare leaders’ revenues are shown in Figure 6. 
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Figure 5. 2006 PLM Revenue Leaders (CIMdata, 2007b) 








9 CIMdata segments the overall PLM market into two primary sub-sectors: PLM information 
authoring and analysis applications (Tools), and collaborative Product Definition management (cPDm) 


(2007b). 


10 These companies are typically considered to be at the forefront of the market in terms of either 
revenue generation or thought leadership (CIMdata, 2007b). 
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Figure 6. 2006 PLM Mindshare Leaders’ Revenue (CIMdata, 2007b) 


E. IMPROVED ENGINEERING DESIGN PROCESS 


For the past several years the Navy has been working to establish a common, 
interoperable IT framework for ship construction and life cycle management enterprises. 
Some of the initiatives that have been implemented to realize this vision are the NDE and 
the Integrated Shipbuilding Environment (ISE). The NDE is a centralized database that 
contains a wide range of data from many sources related to ship repair, maintenance and 
modernization. The ISE seeks to attain data interoperability where business processes 


and IT systems are able to accept, transfer, and disseminate data electronically. 


Naval Sea Systems Command (NAVSEA) is currently developing the Improved 
Engineering Design Process (IEDP) to: 

improve productivity, reduce cost, improve design processes, collect 

technical data quickly, and allow a greater sharing of information between 

all activities involved in lifecycle management, modernization and 


maintenance programs using an easy on-line collaboration process — 
(Stout and Tilton, 2007). 


IEDP is a technology transition project that utilizes 3D terrestrial laser scanning to 
acquire as-built images of shipboard spaces for repair, maintenance and modernization 
activities. Figure 7 shows the architecture of the IEDP. IEDP also promotes cross 
functional collaboration and integrated design environments through UGS’ Teamcenter 


PLM platform. The IEDP fills a void that has long existed in the shipbuilding industry; it 
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addresses needs of ship design and sustainment throughout the ship’s lifecycle!! in a 


common data environment. Benefits currently realized in the IEDP include: 


e Enables L6S implementation for Model/Drawing development and 
sustainment processes that leverage 3D scanning and collaborative 
environment. 

e Reduced site visits by ship check planning team. 

e Captured data can be used to verify dimensional information anytime after 
site visit (reuse). 

e 3D models can be used for many applications such as: 

e Preplanning. 


Generating cost estimates. 
Virtually reviewing tasks with contractors. 


Perform what-if scenarios for rip outs and installation of new 
equipment. 


e Engineering collaboration allows cross functional effort on the same 
project and data exchange between remote sites. 


e Improved Configuration Management and Validation processes: 


Automated Identification Technology (AIT) (e.g. Bar Codes, 
RFID). 


ILS Product Management and visibility (Stout and Tilton, 2007). 
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Figure 7. IEDP Architecture (Stout and Tilton, 2007) 





11 Common lifecycle for a Navy Ship is 30-40 years (Stout and Tilton, 2007). 
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SIS is the prime contractor executing the IEDP solution for NAVSEA under a 
$1.8 million FY 2007 appropriation. The tools provided by the IEDP will let managers 
and engineers view as-built images and related project information in a virtual 
collaborative environment. PLM tools provided by the IEDP have the potential to 
provide Navy leadership with its first ever cradle to grave view of an individual hull or 
class of ship. Having access to complete lifecycle information will enable longitudinal 
analysis of cost, performance and other items to provide a true picture of the total coast of 


ownership for our naval battle force assets. 
F. LEAN SIX SIGMA 


Since the early 1980s a broad range of businesses have adopted L6S principles to 
reengineer their business processes. In recent years, the DoD has widely embraced L6S 
as its preferred business transformation tool. L6S has become the tool of choice for 
modern business transformation activities across the DoD and LOS initiatives are being 
implemented from the level of the Assistant Secretary of Defense down to individual 
commands. All branches of the DoD have implemented guidance for how and when to 


apply L6S principles and some have established L6S training sites for their personnel!2. 


LOS is a business improvement methodology combining tools from both Lean 
Manufacturing and Six Sigma (George, Rowlands, and Kastle, 2004). Lean 
Manufacturing focuses on speed and traditional Six Sigma focuses on quality. When 
theses two are combined as LOS, and applied properly, the result should be a better 
quality product generated in less time. Application of L6S principles provide for 
systematic identification of simple solutions to eliminate waste and produce services at 


the appropriate speed and quality to meet customer demands. 
1. L6S Enabled By PLM 


L6S and PLM are enterprise initiatives that focus on business value (Affuso, 


2004). The DoD is continuously seeking ways to improve quality, process efficiency, 


12 The Norfolk Naval Shipyard established a L6S College in 1999 and has trained more than 2,350 
students from the Navy, Marine Corps, Army, Coast Guard, Air Force and many other agencies (Brayshaw, 
2007) 
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strategic alignment and sustainable growth to get the most out of its scarce resources. 
The current paradigm being followed in the DoD to achieve these improvements is L6S. 
Common benefits of L6S initiatives include cost reduction, decreased cycle-time, less 


material waste, and more reliable products. PLM tools deliver similar benefits. 


L6S provides a statistical measure of factors to help organizations meet desired 
goals and PLM tools capture, store and distribute the longitudinal data necessary for 
accurate and reliable statistical measures. One area the DoD has struggled in is keeping 
accurate longitudinal lifecycle information on its major programs, specifically in ship 
construction, maintenance, modernization and repair. Without an accurate picture of the 
past, effective planning and cost estimation for future projects is difficult. With PLM 
tools, current and historical information are available to any authorized entity in the 
enterprise in a web based, collaborative environment. PLM technology provides a shared 
data environment for the Navy and shipyards to reduce product development/installation 
cycle time, reduce the cost of change and allow collaboration with suppliers to 
dramatically reduce the cost in the value chain. Theses outcomes will enable the Navy 
and shipyards to meet desired L6S targets. PLM technology utilized in the IEDP is 
helping NAVSEA attain its goal of a common, interoperable IT framework for ship 
construction and lifecycle management by providing data management and product 
change management to all stakeholders in a collaborative environment. Figure 7 shows 


the UGS’ Teamcenter modules and their supportive role in lifecycle management. 
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Figure 8. PLM Longitudinal Lifecycle (State of Industry Brief, 2005) 
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2; L6S Supported By KVA 


The KVA methodology provides a framework for quantitative analysis of 
knowledge assets in an organization and has been applied in academic research and 
various business consultations for nearly 20 years. “KVA theory is based on an entropic 
concept, which is predicated upon changes in the environment (Housel and Bell, 2001, p. 
95).” As organizations process inputs, value is added to the original input as it is 
transformed into an output. The value that is added to during the transition from input to 
output is proportionate to the amount of change necessary to cause the transformation as 
shown in Figure 8. Therefore, a unit of change is simply considered as a unit of 


complexity. This assertion provides a means to measure all outputs in common units. 

















rt Xi => p => y upui 


P(X) = Y 

Fundamental assumptions: 

1. If X = Y no value has been added. 

2. “value” o “change” 

3. “change” can be measured by the amount of knowledge required to 
make the change. 

So “value” “change” oc“‘amount of knowledge required to make the 
change” 

(Principle of replication) 











Figure 9. Fundamental Assumptions of KVA (Housel & Bell, 2001)!3 


L6S has two key methodologies: DMAIC (Define, Measure, Analyze, Improve 
and Control) and DMADV (Define, Measure, Analyze, Design and Verify) (Affuso, 
2004). Regardless of which methodology is used, measurement is a primary means to 
determine if the initiative is having the desired results. When enterprise implementations 


are initiated without metrics, there is no way to measure the value achieved and that often 


13 “The principle of replication states that given that we have the knowledge necessary to produce the 
change then we have the amount of change introduced by the knowledge. By definition, if we have not 
captured the knowledge required to make the changes necessary to produce the output, we will not be able 
to produce the output as determined by the process. This allows a test to determine if the amount of 
knowledge required to produce an output has been accurately estimated” (Housel & Bell, 2001, p.94). 
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results in a failed implementation. A client of UGS (a market leader of PLM products) 


explains the importance of measurement in the following way: 


e We don’t know what we don’t know. 

° If we can’t express what we know in the form of numbers, we really don’t 
know much about it. 

e If we don’t know much about it, we can’t control it. 

° If we can’t control it, we are at the mercy of chance (Affuso, 2004, p.7). 


Performance metrics for productive DoD assets may use many different units of 
measure for benefits. It is easy to discuss cost because it is usually monetized but 
discussing value in a non-profit environment proves much more difficult. KVA 
methodology provides a way to measure value as common units of output, dollars for 
instance, and it provides a more accurate comparison for developing key metrics 


supporting L6S initiatives in the DoD. 


A metric commonly used in business and government is ROI. ROI can be derived 
by subtracting the cost to produce an output from the revenue, or value, generated by the 
output and dividing that value by the cost (Rev-Cost/Cost). The denominator, cost, is 
usually easy to determine and quite reliable. The numerator, revenue, can be a bit more 
difficult to determine especially in government and non-profit organizations. It is 
difficult to estimate ROI on organizational assets such as IT systems, but KVA provides a 
framework to allocate revenue to productive assets by describing all outputs in common 
units. Consequently, the DoD can utilize a reliable and standardized measure of value for 
ROI or other metrics that require a quantitative measurement of value in support of L6S 


initiatives. 
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HI. PREVIOUS RESEARCH 


A. KOMOROSKY’S ANALYSIS AND FINDINGS 


In 2005, LT Komorosky conducted research which evaluated: 


the conjectural benefits resulting from the integration of new IT assets!4 
into existing Navy shipyard design processes, with focus on the work and 
output generated at the public-sector Planning Yard facilities — (2005, 


p.2). 


In her work, LT Komorosky identified seven sequential core processes, shown in 
Figure 9, utilized by planning yards to accomplish ship alterations on U.S. Navy surface 
ships. A baseline as-is environment was modeled and compared to notional 
environments representing “maximum utilization of the new IT resources” (2005, p. 44). 
LT Komorosky’s baseline data for the as-is environment was compiled by conducting 


extensive interviews with SMEs of the Puget Sound Planning Yard. 


Key KVA data points of actual learning time (ALT), ordinal ranking, and 
relative learning time (RLT) were compared and a correlation of greater 
than 80 percent was attained, proving the estimates as credible — (2005, 
p.23). 


Issue Tasking 


“Tnterpret Orders 
Plon ee Sh ipcheck 
Conduct Shipal reek 
Report Assembly 
Revise Schedule 


Generate Drawings 


Figure 10. Planning Yard Core Processes (Komorosky, 2005) 


14 The specific IT assets evaluated were SIS’s 3DIS laser scanner and UGS’s Teamcenter PLM 
software suite (Komorosky, 2005). 
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The first notional environment, the to-be scenario, evaluated the effects of adding 
3D laser scanning to the as-is baseline. In the as-is environment $45 million was spent 
annually to execute the defined shipyard planning process cycle 40 times across the four 
public shipyards. By adding 3D laser scanning to the planning process cycle, costs were 
forecast to drop a remarkable 84 percent to less than $8 million as seen in Table 1. 
Introduction of 3D laser scanning in the to-be environment had a profound effect on 
process steps 3, 4 and 7 leading to a cost savings of nearly $37 million (Komorosky, 


Housel, Hom and Mun, 2006). 


The second notional environment, the radical-to-be scenario, evaluated the effects 
of adding 3D laser scanning and a collaborative PLM suite of software to the as-is 
baseline. The forecast from this scenario was a cost savings of nearly $40 million, a 90% 
reduction, from increased savings in process steps 3, 4 and 7 and additional savings 


realized in steps 2 and 5. 


Process Title "AS IS" "TO BE" "RADICALTO BE" 


1 


ISSUE TASKING 


$173,500 


$173,500 


$173,500 


“AS IS” & 
“TO BE” 
Cost Savings 


“AS IS” & 
“RADICAL” 
Cost Savings 











INTERPRET ORDERS 


$520,000 


$520,000 


$328,000 





PLAN FOR SHIP 
CHECK 


$1,655,000 


$714,000 


$374,500 





CONDUCT SHIP 
CHECK 


$2,604,500 


$1,364,000 


$1,041,000 





REPORT ASSEMBLY 


$235,000 


$235,000 


$122,000 





REVISE SCHEDULE 


$131,000 


$131,000 


$131,000 





2 
3 
4 
5 
6 
7 


GENERATE 
DRAWINGS 


Table 1. 


$39,386,000 


TOTALS $44,705,000 


KVA Results — Analysis of Costs (Komorosky et al., 2006) 





$4,716,000 


$7,853,500 





$2,319,000 


$4,489,000 


$0 

$0 

$941,000 
$1,240,500 
$0 

$0 
$34,670,000 
$36,851,5000 





$0 
$192,000 


$1,280,500 
$1,563,500 
$113,000 
$0 
$37,067,000 





$40,216,000 


LT Komorosky’s research was conducted within the scope of the core processes 


of the planning yard. This represents a small piece of the overall process leading to the 


actual installation, modernization or repair of surface ships. By expanding the micro 


view of previous research across the larger realm of the SHIPMAIN environment, the 


impact of 3D laser scanning and PLM technologies can be evaluated in a more 


comprehensive manner. 
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B. NATIONAL SHIPBUILDING RESEARCH PROGRAM STUDIES 


NSRP was created by U.S. shipyards at NAVSEA request to reduce the 
cost of building and maintaining U.S. Navy warships. NSRP is structured 
as a collaboration of 11 major U.S. shipyards focused on industry-wide 
implementation of solutions to common cost drivers. NSRP's flagship 
R&D program, Advanced Shipbuilding Enterprise (ASE), targets solutions 
to priority issues that exhibit a compelling business case to improve the 
efficiency of the U.S. Shipbuilding and Ship Repair Industry. Solutions 
include leveraging of best commercial practices and creation of industry- 
specific initiatives. Aggressive technology transfer to, and buy-in by, 
multiple U.S. shipyards is a requirement of all funded efforts — (National 
Shipbuilding Research Program Advanced Shipbuilding Enterprise, 2007). 


Komorosky’s (2005) evaluation of “the conjectural benefits resulting from the 
integration of new IT assets into existing Navy shipyard design processes” was predictive 
in nature (p. 2). It relied on validated estimates from SMEs in the shipbuilding industry. 
While these estimates attained a desirable level of correlation, none of the data points 
were from physical experiments using the technologies evaluated. However, NSRP has 
recently completed a two-part field experiment utilizing 3D laser scanning technologies 


from several vendors on actual shipyard projects. 
1. NSRP 2005 Ship Check Data Capture Project 


In the spring of 2005, the NSRP’s Strategic Investment Plan added a new 
initiative to focus on as-built data capture for performing ship repairs and maintenance 
(National Shipbuilding Research Program Advanced Shipbuilding Enterprise, 2006). 
The objectives of the NSRP ASE Ship Check Data Capture Project in 2006 were: 


e To develop a process that captures the as-built measurement data in 
digital/electronic format during a ship check. 


e To process the as-built measurement data into 3D CAD models using 
available COTS modeling technologies (software and hardware) 


e To ultimately provide a building block process for the anticipated 
development of the capabilities to generate 3D CAD models of the as-built 
space envelope from the geometric measurement data captured during the 
ship check. 
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The process investigated and developed through this research was focused on providing 
acquisition and lifecycle cost relief to the government through the generation and 


management of accurate 3D CAD models and geometric measurement data. 


During the project, multiple vendors conducted data capture onboard a Torpedo 
Weapons Receiver (TWR 841) and the USS Georgia (SSGN 729) using either 3D laser 
scanning or Digital Photogrammetry. Software solutions for post collection processing of 
ship check data were also evaluated. Once data capture and post processing were 
completed, each vendor’s product was evaluated for accuracy of measurement and their 
individual data process flow and the overall process was evaluated for cost savings and 


cycle time reduction. 


Findings on cost and time savings were categorized as for a small ship check or a 


large ship check and are summarized in Table 2. 





SMALL SHIP CHECK: 
Traditional Laser Scanning Realized Savings 
Cost $9,351 $6,398 32% 
Labor Hours 112 {2 36% 


LARGE SHIP CHECK: 
Traditional Laser Scanning Realized Savings 


Cost $47,650 $26 465 44% 
Labor Hours 660 336 49% 








Table 2. Ship Check Data Project Cost/Time Savings (Komorosky et al., 2006) 


One of the goals of this project was to demonstrate a 50 percent time savings over 
traditional methods (National Shipbuilding Research Program Advanced Shipbuilding 
Enterprise, 2006). The large ship check environment was very close to attaining that 
goal. The savings demonstrated in Table 2 are only for the first ship check and do not 
account for elimination of future ship checks on the same space so it is likely that on 
successive ships a 50 percent time savings will be realized. For a detailed table of cost 


savings analysis see appendix C. 
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2; NSRP 2006 Ship Check Data Capture Follow-On Project 


Electric Boat was awarded a FY 2006 follow-on ship check project by NSRP 
ASE (2007) to evaluate the FY 2005 ship check process further and provide a refined 
ship check process to the U.S. shipbuilding and repair industry using available COTS 
technology. To accomplish these goals, the project team conducted a ship check aboard a 
280 foot Inspection, Maintenance and Repair (Candies IMR) vessel under construction. 
A ship check was also conducted aboard SSGN 729 to validate the data 
accuracy/repeatability of the SSGN 729 ship check data collected from the FY 2005 


project and to refine the ship check process. 


The ship evaluated at Bender was the 280 foot Candies IMR vessel under 


construction. Figure 10 shows the spaces that were ship checked. 





3,4 7 1 


Bow thruster recesses (Port and Starboard)/Anchor pockets (Port and Starboard) — (1,2) 
Moon pool/Door fit-up (3,4) 

Z-drive Recesses (Port and Starboard) and Z-drives (Port and Starboard) — (5.6) 
Engine room bulkhead (7) 

Pilot House (8) 


Figure 11. Candies IMR Ship Check Spaces (National Shipbuilding Research Program 
Advanced Shipbuilding Enterprise, 2007) 


The ship checks conducted in this study lead to the creation of a refined ship check 
process intended to provide cost savings as compared to traditional ship checks using 
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manual methods. The cost and time savings demonstrated in this study are from typical 
ship check post processing efforts of the valve station from the ship check data capture 
compared to the traditional ship check using tape measures and manual sketches. 


Findings on cost and time savings are shown in Table 3. 


Traditional Laser Sacnning Realized Savings 
Cost $8,327 $5,248 37% 


Labor Hours 118 72 39% 





Table 3. Follow-On Ship Check Project Cost/Time Savings (National Shipbuilding 
Research Program Advanced Shipbuilding Enterprise, 2007) 


The 2006 project demonstrated that laser scanning technology is mature enough 
to support the ship check process, and provides desirable time and cost savings during 
ship checks. It found laser scanning also eliminates return visits to the site to obtain 
measurements that are normally missed using traditional ship check methods. Finally, 
the project validated that a significant vendor network exists to support ship checks with 
laser scanning based data capture and post-processing and recommends that shipyards 


consider using vendor services to aid their initial use of the technology. 
c. MAP TO SHIPMAIN 


The cost and time savings demonstrated in NSRP’s ship check data project 
indirectly support LT Komorosky’s predictive study findings in that both demonstrate a 
remarkable cost savings and decreased cycle time when 3D laser scanning tools are used 
to acquire as-built configurations of ships. Komorosky’s seven core processes describe 
the navy planning yard process in a legacy FMP context and are still relevant in the 
current SHIPMAIN EP as validated by a SME with 38 years of experience in the 
shipyard industry (Anonymous, personal communication, March 2007). Figure 11 shows 
a detailed view of Komorosky’s evaluation of the core processes in the navy planning 


yard. 
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Figure 12. Planning Yard Core Processes (Komorosky et al., 2006) 


Phases IV and V of the SHIPMAIN process consist of eight core processes 
referred to as blocks (Commander, Naval Sea Systems Command, 2006). Blocks 250 
and 265 of the core can be further decomposed to 11 sub-processes. Komorosky’s 
planning yard process maps directly to block 265, specifically sub-block 265.1 of the 
SHIPMAIN process as shown in Figure 12. Sub-block 265.1 is where Komorosky’s 
detailed sub-processes, as described in Figure 11, can be applied. The detailed process 


flow chart for sub-block 256.1 is shown in Figure 13. 


Zi 





Komorosky’s 7 Core 
Processes Map To These 
Sub-Processes 


Phase IV 
Implementation 


Phase V 
Installation 


Figure 13. Mapping of Komorosky’s Core Processes to SHIPMAIN 
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Figure 14. Detailed View of Block 265.1 Commander, Naval Sea Systems Command, 
2006) 


Figure 12 may give the impression that Komorosky’s research was very small, 
and therefore not remarkably significant, when placed into the context of SHIPMAIN. 
However, when the blocks are placed into context based on their complexity, number of 


personnel involved and number of times executed that impression should fade. Three 
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SMEs, each with more than 30 years of experience in the shipyard industry, rated block 
265 as the most complex and difficult to learn. Block 265 is where LT Komorosky’s 
research maps to, and in addition to being the most complex, it requires 5 times more 
personnel to accomplish than six of the seven other blocks!5 and is utilized in every 


instance of SHIPMAIN. 


In the next chapter, Komorosky’s findings will be conditionally applied to related 
sub-processes of block 265 in the creation of a to-be version of SHIPMAIN. The seven 
remaining blocks and their sub-processes will also be evaluated using the KVA 


methodology based on reliable SME estimates for ALT, RLT and process difficulty. 


15 Block 300 is equivalent to block 265 in complexity, training time and personnel involved 
(Anonymous, personal communication, May 2007). 
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IV. METHODOLOGY PROOF OF CONCEPT 


A. INTRODUCTION 


Phases IV and V of the SHIPMAIN process were created from input and 
discussion by various stakeholders at NAVSEA, Type Commanders (TYCOM), public 
and private shipyards, Space and Naval Warfare Systems Command (SPAWAR), Office 
of the Chief of Naval Operations (OPNAV) and other entities with a vested interest 
maintenance and modernization efforts (Commander, Naval Sea Systems Command, 
2006). Business rules for these phases are regularly reviewed and updated to be properly 
aligned with business goals and the needs of Fleet Commanders. Currently, phases [V 
and V of SHIPMAIN are not in a functionally implemented state but are rather in an early 
adoption period while business rules/processes mature and long standing legacy practices 
give way to the SHIPMAIN process. A key assumption of this proof of concept case is 
that the SHIPMAIN process functions as described in the business rules listed in 
appendix D of the SSCEPM dated 11 December 2006. 


The following proof of concept case will use the as-is process information 
compiled from interviews, conversations and correspondence with a select group of 
SMEs from NAVSEA. Their input will be statistically analyzed for reliability and all 
estimates will be aggregated to reflect the cost and number of process executions 
averaged over five years. The KVA methodology will be applied to determine the 
potential effects of introducing 3D terrestrial laser scanning and PLM technologies into 
phases IV and V of the SHIPMAIN process. The effects of adding 3D laser scanning 
have been evaluated by LT Komorosky (2005) and NSRP (2006 & 2007) and will be 
applied in a single notional scenario with PLM technologies. If the introduction of these 
IT assets has a positive effect on the SHIPMAIN process, it will be evident through 
increased return on knowledge (ROK)/ROI values and associated cost estimates. If there 
is a negative effect, the inverse will be evident. These figures will be shown as a 
comparison of the current as-is scenario to the to-be scenario using defendable future 


process estimates. 
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B. DATA COLLECTION AND METHODOLOGY 


Aggregate data was gathered during an initial KVA knowledge audit conducted 
via survey and a group interview setting at NAVSEA, Washington Navy Yard, DC. 
Three SHIPMAIN SMEs were present at the group interview and each had expertise 
related to the SHIPMAIN process. Each of the three SMEs has over 30 years experience 
in the shipyard industry, with a high degree of expertise in their affiliated disciplines. 
The business rules for phases IV and V of the SHIPMAIN process guided the interview. 


1. Learning Time Method 


The method of analysis for this proof of concept is the Learning Time method!©®, 
A thorough review of current SHIPMAIN business rules and discussion with SMEs 
established what processes constitute the core of SHIPMAIN phases IV and V, identified 
the inputs and outputs of those processes, and determined the frequency of core process 
iterations. Boundaries were established between the defined processes in order to 
effectively apply the KVA methodology, and to properly identify and valuate the 
knowledge required for each. Eight core processes were identified and detailed 
descriptions of each were provided by SMEs and the SHIPMAIN business rules. Each 
core process requires a certain level of knowledge in one or more of the following areas: 
administration, management, scheduling, budgeting, basic computer skills, engineering, 


shipboard systems, logistics or project management. 


The SMEs spent considerable time contemplating the amount of knowledge 
embedded in each core process, and provided ALT estimates for each. The established 
baseline level of knowledge for consideration was a GS-13 employee with | year of 
experience and a college degree (no field specified). Finally, the team of SMEs provided 
individual and uninfluenced RLT and rank order estimates which lead to a correlation of 
greater than 80 percent, thereby establishing a high level of reliability on the ALT figures 
obtained. Additional discussion occurred spontaneously among the SMEs which lead to 


a group conclusion that blocks 265 and 300 were equivalent in complexity. Adjusting the 





16 See Appendix A for a detailed discussion of Learning Time. 
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relative learning time and rank order to reflect that conclusion leads to greater 


than 90 percent correlation across the data fields. 
C, THE DEFINED SHIPMAIN PROCESS FOR PHASES IV AND V 


Before a business process can be reengineered or automated, the current as-is 
process must be understood. The business rules for phases IV and V of SHIPMAIN 
describe eight core processes, referred to as blocks, which encompass implementation 
and installation of approved SC. Each block has an official title to reference the core 


process it accomplishes as shown in Figure 15. 


4 BLOCK 250 ‘j 
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Figure 15. SHIPMAIN Core Processes (Commander, Naval Sea Systems Command, 
2006) 


This chain of core processes is executed for every naval vessel as it approaches 


and completes a shipyard availability period. The schedule timeline and location for ship 
a2 


availabilities are established by Navy leadership far in advance, but calendar dates and 
work assigned may be constrained by budget allowances and other prioritization factors. 
Availability schedules may be affected if world events trigger an unanticipated demand 


for operational naval assets. 


The core processes for SHIPMAIN phase IV (block 250-280) and phase V (block 
300-330) are described in detail in appendix D. As mentioned previously, phases IV and 
V are still in an early adoption period and are not widely used across shipyards at this 
point. A key assumption for the purpose of this study is that phases IV and V are being 
conducted as described in the business rules listed in appendix D of the SSCEPM dated 
11 December 2006. 


D. KVA ANALYSIS OF AS-IS SCENARIO 


A summary of the high level as-is KVA analysis is depicted in Table 4. These 
estimates were compiled from interviews of SMEs at NAVSEA and historical data 
contained in the NDE. This sample is representative of availability periods for ships of 
the Pacific and Atlantic Fleet, to include Aircraft Carriers, averaged from FY 2002 to FY 
2007. All estimates contained in this analysis are as conservative and accurate as 


possible. 
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Table 4. SHIPMAIN Phases IV and V As-Is Core Process Model 
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1 Bs Number of Employees 


The number of employees value used to build this model represents the number of 
employees assigned to complete the given process for each cycle or iteration. The 
numbers assigned are based on interviews with SMEs. By accounting for the number of 
personnel involved in each process, it can be determined how often knowledge is used. It 


also provides an approximate way to weight the cost of using knowledge in each process. 
2. Times Performed in a Year 


Estimations for the number of times each process is executed per year are based 
on the aggregated number of occurrences for each process. The number of times 
performed for blocks 265 to 330 is based on the number of installations of maintenance 
or modernization items. The number of times performed for block 250 is based on the 
number of availability periods. The NDE was queried with the following filters to gather 
the raw data: 

e The search was limited to title “K” and “P” alterations. 

e FY 2002 through 2007. 

e Ships of the following TYCOMs: 


e Commander, Naval Air Force Atlantic 

° Commander, Naval Air Force Pacific 

° Commander, Naval Surface Force Atlantic 
° Commander, Naval Surface Force Pacific 


These filters were put in place to establish a five year average of maintenance or 
modernization availability periods for all surface combatant ships to include Aircraft 
Carriers. The result of the query was that an average of 1,200 availability periods occur 
each year. This number was conditionally modified to take the complexity of installs 
during availability periods into consideration. Some availability periods conduct routine 
software upgrades and have a low complexity while the other end of the scale would be 
modernization efforts for Ticonderoga class Cruisers. To provide a reasonable scope, 25 
percent of availability periods were considered to be simple, 25 percent complex and 50 


percent moderate. 600 moderately complex installations frame the scope of this model. 
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The number of times performed for the remaining blocks is based on the number 
of installations that occur. For each installation that occurs, a SCD is generated and the 
number of SCDs provides a reliable proxy for the number of installations. SMEs 
provided data and analysis which estimates an average of 20 SCDs are initiated per week 
leading to 1,040 SCDs generated annually. Again applying the same conditional 


modifier to account for complexity, 520 SCDs or installs, would occur each year. 
3 Actual Learning Time 


In order to determine the ALT from a common point of reference, the SMEs were 
instructed to imagine a baseline individual of a college graduate at the GS-13 civilian 
rank level with a year of experience in some sector of the shipyard industry. All experts 
understood that each process learning time estimate must adhere to the basic assumptions 
that knowledge is only counted if in use, and the most succinct path to achieve a unit of 
output must be considered. Each core process was broken down into its component sub- 
processes and respective ALT values were assigned for each sub-process. The final ALT 
value for each core process is a summation of the sub process ALT estimates. Finally, all 
ALT values are based on the following time assumptions: 

e One year = 230 work days 

e One month = 20 work days 

e One week = 5 work days 


e One day = 8 hours 
4. Determining Value 


Each process contains a certain amount of process automation ranging from zero 
to 100 percent. The amount of automation is a proxy for how much knowledge is 
embedded in IT supporting the automation. It is important to estimate how much of each 
process is automated, and to be consistent in those estimates, so that the knowledge 
embedded in the technology resources is accounted for. Upon determination of the 
percentage estimate, the Total Learning Time (TLT) is calculated by dividing ALT by the 


percentage of process automation for that process. 
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The TLT value is then multiplied by the number of employees and the number of 
times the process is performed per year to establish a Total Knowledge factor. The Total 
Knowledge factor is then multiplied by a price per common unit, based on market 
comparables, to derive the “benefits” or “value” of each process. The resulting product is 


then used as the numerator for determining ROK and ROI. 


5. Cost Estimation 


To estimate the cost of government employees involved in the processes, the 2007 
civilian pay chart was referenced. Each civilian pay grade has associated “steps” to 
account for various unique factors of each job. All pay estimates are based on step six of 
the associated pay grade. Since the processes take place across the globe, no locality pay 
differentials were taken into consideration to minimize variation. Also, because basic 
computing hardware and software is utilized in every scenario, IT cost is not included in 
the as-is analysis. It is assumed that each employee in this process has an email account, 
laptop or desktop computer with identical software, and access to a printer. Material, 
travel, and other miscellaneous costs are not included in this analysis so labor cost may 


be isolated. 


Establishing a market comparable for government labor was accomplished by 
comparing the pay of contractors who conduct the same type and scope of work as the 
government employee. The contracted base pay was on average 35 percent higher than 
the government employees. Benefits, locality pay differential and other variables were 
not compared to establish this rate, only base pay was considered. All government 
employee rates were increased by 35 percent to achieve the values for the market price 


used to establish a price per common unit of output. 


6. As-Is Process Data Analysis 


Each core process is depicted in a table format to show the respective process 
instructions and values derived from them. It is necessary to evaluate each sub processes 
at this level of detail to best capture the impact of introducing 3D laser scanning and 


PLM software in the notional to-be model. 


ad 


a. Key Assumptions 


As previously mentioned, this analysis is based on information collected 
from previous research by LT Christine Komorosky (2005), SMEs from NAVSEA, data 
contained in the NDE and current directives. For the purposes of this study, all 
maintenance and modernization efforts are assumed to occur as described in the current 
business rules listed in appendix D of the SSCEPM dated 11 December 2006. It is also 
important to keep in mind that maintenance and modernization efforts vary substantially 
in number, manpower requirements, duration and complexity. After conducting 
extensive interviews with SMEs and conducting a thorough review of current directives, 
related research and existing data in the NDE, the following assumptions were made: 


e Of 1,200 annual modernization and maintenance availability periods, 25 
percent involve low complexity installations, 25 percent high complexity 
installations and 50 percent involve medium complexity installations. 
Assume all efforts in this study involve efforts of medium complexity. 


® On average, 20 SCDs are generated per week. 


e The market comparable labor rate is 35 percent greater than the 
government labor rate. 


e Price per common unit of output is $75.45. 
b. Block 250 KVA Analysis 


Table 5 shows key KVA estimates used to determine the total process 


benefits, annual cost, ROK and ROI for block 250. 


Block 250 
Authorize and Issue Letter of Authorization (LOA)/Hull Maintenance Plan (HMP); Generate 2Ks 


Hourly Time to 
Personnel | Head | Times Perf.| Complete Annual Total 
Sub process Cost count| Per Year (Hrs) Personnel Cost AT |ALT (Hrs)} Knowledge Total Benefits Annual Cost 











Create AHMP/EHMP. $42.45 1 600 40 $1,018,800 75%. 96000 $7,127,985 $1,018,800 
Create Annual HMP/LOA $42.45 1 1200 40 $2,037,600 75%. 153600 $11,404,776 $2,037,600 
Initiate 2Ks into ICMP $35.70 3 520 40 $2,227,680 0% 49920 $3,706,552 $2,227,680 
Generate/issue QISM $42.45 4 4 40 $27,168 90% 5120 $380,159 $27,168] 1399%] 1299%| 


Process Totals: 
Table 5. Block 250 As-Is KVA 






































Block 250 is primarily a management based activity. The annual cost is 
relatively low since there are few employees involved in the management activities of 
this process. This process contains a large percentage of automation which enables a 
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small number of people to execute the process many times leading to high ratios for ROK 
and ROI. One thing to consider is that the cost of the IT assets is not addressed in this 


model; the actual costs shown in Table 5 only reflect labor cost. 
c. Block 265 KVA Analysis 


Table 6 shows key KVA estimates used to determine the total process 


benefits, annual cost, ROK and ROI for block 265. 


Block 265 


Hull Installation and Risk Assessment 

Hourly Time to 
Personnel | Head | Times Perf.| Complete Annual Total 
Sub process Cost count| Per Year (Hrs) Personnel Cost AT |ALT (Hrs)} Knowledge Total Benefits Annual Cost 











Installation Procurement, Design & 
Advance Planning $43.10 35 520 160 $125,507,200 $72,071,847 _|$125,507,200 [57% 


265.2 _|Hull Installation Readiness Review $29.78 520 40 $1,238,848 208000 [$15,443,967 [$1,238,848 1247% ]1147% 


2 
265.3 [Evaluate Maturity Status 1 $521,664 $1,544,397 $521,664 296% 
1 





265.4 [Provide Risk Assessment $1,043,328 $2,162,155 [$1,043,328 [207% 

Formally Propose Install for 
1265.4.1|Readniess Assessment and Auth. $521,664 $1,544,397 $521,664 296% 
265.5 |Risk/Readiness Determination $1,227,408 $2,162,155 $1,227,408 T76% 


Process Totals: $94,928,918] $130,060,112| _73%| _-27% 


Table 6. Block 265 As-Is KVA 



































This block was evaluated as the most complex block by all of the SMEs. 
It involves management an operational tasks requiring significant knowledge assets, a 
large budget and significant manpower. Once approval has been given from block 250, 


the goal of block 265 is to: 


Complete all required design, procurement of material, pre-installation 
testing, and obtain all required certifications/risk assessment(s)... 
(Commander, Naval Sea Systems Command, 2006, Appendix D, p. 77). 


LT Komorosky noted that, “reducing the time required to conduct a ship check provides 
the greatest opportunity to improve Navy ship cycle time” (2005, p. 42). The ship check 
process LT Komorosky refers to is contained in sub process 265.1 and should 

demonstrate a reduced cycle time at less cost when 3D laser scanning and PLM tools are 


introduced to this sub process. 


For alterations involving Command, Control, Communications, 
Computers, Combat Systems and Intelligence (CSI) assets, a quarterly meeting takes 


place to conduct sub processes 265.2 through 265.5. Representatives from across the 
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globe meet in a single conference hall quarterly to address the issues at hand 
(Anonymous, personal communication, May 2007). Introducing comprehensive 
collaboration tools to these processes has the potential to remarkably decrease cost and 


cycle time by eliminating costly travel expenses and associated travel time. 
d. Block 270 KVA Analysis 


Table 7 shows key KVA estimates used to determine the total process 


benefits, annual cost, ROK and ROI for block 270. 


Block 270 


Authorize Installation 
Hourly Time to 





Personnel | Head | Times Perf.| Complete Annual Total 
Sub process Cost count | Per Year (Hrs) Personnel Cost %IT |ALT (Hrs)} Knowledge Total Benefits Annual Cost ROK 


Installation decision $76.00 4 520 20 $3,161,600 Yo 24 332800 $24,710,347 $3,161,600 


Table 7. Block 270 As-Is KVA 



































Block 270 involves management decisions at the highest levels of the 
organization, typically the GS-15 or Senior Executive Service level. Therefore, there are 
few employees involved, but they carry a substantial labor cost. This process has a high 
level of automation which allows a small number of people to execute it often. 
Accordingly, the cost is very low when compared to the benefits leading to high ROK 
and ROI ratios. It is important to mention again that this model does not account for the 


cost of the IT assets providing the high level of automation, only the labor cost. 
e. Block 280 KVA Analysis 


Table 8 shows key KVA estimates used to determine the total process 


benefits, annual cost, ROK and ROI for block 280. 


Block 280 
Resolve "Not Authorized/Deferred SC" 


Hourly Time to 
Personnel | Head | Times Perf.| Complete Annual Total 
Sub process Cost count| Per Year (Hrs) Personnel Cost AT |ALT (Hrs)} Knowledge Total Benefits Annual Cost 


Update HMP,LOA and Fielding Plan $3,706,552 $619,424] 598%] 


Table 8. Block 280 As-Is KVA 
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Block 280 also contains a process that is primarily a managerial task. It 
involves a low number of employees at one of the lowest labor rates. The high level of 
automation coupled with a low labor cost and high levels of process execution lead to 


favorable ROK and ROI ratios. 
f Block 300 KVA Analysis 


Table 8 shows key KVA estimates used to determine the total process 


benefits, annual cost, ROK and ROI for block 300. 


Block 300 
Install SC 





Hourly Time to 


Personnel | Head | Times Perf.| Complete Annual Total 
Sub process Cost count | Per Year (Hrs) Personnel Cost %IT |ALT (Hrs)} Knowledge Total Benefits Annual Cost ROK 



































Complete installation and testing $42.45 46 520 40 $40,616,160 40 1275733 $94,722,998] $40,616,160 


Table 9. Block 300 As-Is KVA 


SMEs rated block 300 a close second to block 265 in complexity. This 
process is where alterations to the ship are actually installed and tested. This process 
requires significant knowledge assets, a large budget and significant manpower, similar 
to block 265. This block has few management review sub processes and is primarily 
focused on completing installations and testing them. Due to the high number of times 
the process is performed per year the cost is relatively low when compared to the 


benefits. 
g. Block 310 KVA Analysis 


Table 10 shows key KVA estimates used to determine the total process 


benefits, annual cost, ROK and ROI for block 310. 


Block 310 
Feedback: Cost, CM, Performance, Schedule, ILS 





Hourly Time to 
Personnel | Head | Times Perf.| Complete Annual Total 
Cost count| Per Year (Hrs) Personnel Cost AT |ALT (Hrs)} Knowledge Total Benefits Annual Cost ROK 


Sub process 



































Provide Feedback Data $29.78 2 520 20 $619,424 \%o $1,853,276 $619,424 


Table 10. Block 310 As-Is KVA 


4] 


As shown in Table 10, there is no automation for this process. The 
process involves taking the raw feedback data and manually entering it into required 
forms and databases. This manual process could become much more efficient with some 


form of automation tool leading to lower process cost and increased benefits. 
h. Block 320 KVA Analysis 


Table 11 shows key KVA estimates used to determine the total process 


benefits, annual cost, ROK and ROI for block 320. 


Block 320 


Continue Installs 
Hourly Time to 





Personnel | Head | Times Perf.| Complete Annual Total 
Sub process Cost count| Per Year (Hrs) Personnel Cost ALT (Hrs)| Knowledge Total Benefits Annual Cost 


Determine impact on future installs 
from Feedback in 310 $59.01 5 520 20 $3,068,520 %o 24 62400 $4,633,190] $3,068,520 


Table 11. Block 320 As-Is KVA 



































Block 320 is a management based process which uses the feedback 
provided in the previous block to determine potential impact on follow-on installs. This 
process is a completely manual process reliant upon the feedback provided in block 310. 
This process has the potential to become more efficient and reliable from an automation 


and analysis tool. 
tL Block 330 KVA Analysis 


Table 11 shows key KVA estimates used to determine the total process 


benefits, annual cost, ROK and ROI for block 330. 


Block 330 


Final Install, Closeout SC 
Hourly Time to. 
Personnel | Head | Times Perf.| Complete Annual Total 





Sub process Cost count| Per Year (Hrs) Personnel Cost AT |ALT (Hrs)} Knowledge Total Benefits Annual Cost ROK 
330 Verify all SCs have been completed $29.78 1 520 20 $309,712 0% 24 12480 $926,638) $309,712] 299% 


Table 12. Block 330 As-Is KVA 
































Block 330 is a review of all planned installations to determine if they have 


been completed. This is accomplished by manually comparing planned installations 
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against reported completions and verification of all ILS completion/delivery for all 
installs. If all planned installs are complete and ILS is delivered, the SC can be closed 
out. This process is also completely manual and could potentially become more efficient 


if an automation and analysis tool was introduced to the process. 
E. TO-BE PROCESS DATA ANALYSIS 


This scenario represents a combination of notional and verified data to portray 
current activities contained in the SHIPMAIN process reengineered to maximize 
utilization of 3D laser scanning and PLM assets. Not every sub process will be affected 
in this scenario; instead, only affected processes will be used for comparison. All others 


may be assumed static as described in their as-is state. 
1. Cost of 3D Terrestrial Laser Scanning Technology 


The cost for laser scanning equipment and required software was provided by the 
IEDP Project Manager for SIS. SISs IEDP Project Manager stated that the current cost 
has not changed from the estimates LT Komorosky used in her 2005 research (B. Tiltion, 
personal communication, May 16, 2007). For this study, the cost for IT used in LT 
Komorosky’s 2005 study will be increased by 3 percent to account for inflation and will 


be amortized over a 10 year period. Cost and assumptions for the 3DIS are: 


° Current inflation adjusted initial cost is $90,640 for one 3DIS scanner and 
its applicable software suite. 

e Maintenance/upkeep annual cost estimate is 20 percent. 

e Use estimate of 200 days per year. 

e A lifespan estimate of 10 years 


e The resulting cost per unit per day is: $135.96. 


° For analysis of the to-be KVA model, this cost is absorbed by the actual 
scanning process contained in block 265.1. 


The six planning yards that support naval surface force assets are: 

@ Bath Iron Works, Bath , ME 

e Norfolk Naval Shipyard, Norfolk, VA 

e Northrop Grumman Ship Systems, Avondale OP, New Orleans, LA 
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° Northrop Grumman Ship Systems, Ingalls OP, Pascagoula, MS 
° Puget Sound (DET) Boston, Boston, MA 


e Puget Sound Naval Shipyard, Bremerton, WA (NAVSEA Shipbuilding 
Support Office, 2007) 


To properly account for the enterprise-wide cost of the 3DIS product, the daily cost was 
increased by a factor of six under the assumption that each planning yard received one 
scanner with the required software. Accordingly, the daily cost to introduce 3DIS across 


the enterprise would be $815.76. 
Zz. Cost of PLM Technology 


SIS is a Value Added Reseller of UGSs PLM suite of software called Teamcenter. 
Under the IEDP, Teamcenter products will be introduced to establish an Integrated Data 
Environment using team collaboration and configuration data management platforms. 


The Teamcenter suite contains the following specific product solutions: 


e Community Collaboration 

e Compliance Management 

e Engineering Process Management 

e Enterprise Knowledge Management 
e Lifecycle Visualization 

e Maintenance, Repair and Overhaul 
e Manufacturing Process Management 
e Portfolio and Program Management 
e Reporting and Analytics 

e Simulation Process Management 

e Supplier Relationship Management 


e Systems Engineering (UGS Corporation, 2007) 


For the scope of this study, Community Collaboration, Engineering Process 
Management, Lifecycle Visualization, Portfolio and Program Management, Reporting 


and Analytics and the Supplier Relationship Management solutions will be considered. 
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These solutions will be part of the complete PLM solution evaluated in the to-be model. 
Cost estimation for these tools has proven to be difficult. According to a leading PLM 
provider, 

Identifying an accurate, average or generalized pricing schema for 

respective toolsets within the PLM space is almost unachievable. It is safe 


to say, however, that vendor’s price-models have been decreasing over the 
years — (Anonymous, personal communication, June 2007). 


To establish a reasonable cost for the Teamcenter solution, the following cost 
estimation will be used: 


e An assumption that PLM and Enterprise Resource Planning (ERP) 
initiatives are similar in cost and scope. 


e DoD spent an average of $250 million per ERP initiative in FY 06 
(Service Cost Estimating Organizations, 2007). 


e The Department of the Navy (DoN) budget for FY 06 was $122.9 billion 
including supplemental transfers (Bozin, 2006) 


° DoN budget for Ship Depot Maintenance was $3.72 billion or 3 percent of 
the entire DoN budget (Bozin, 2006). 


e 3 percent of a $250 million (the cost for an ERP) is $7.5 million. 


The $7.5 million PLM solution will be deployed at the six planning yards listed 
earlier in this section and all SYSCOMs/TYCOMs supporting surface force combatant 
assets. The cost for the PLM suite will be amortized over 10 years with a 2 percent 
annual increase for the cost of version upgrades bringing the total cost to $9 million 
which will be amortized over a ten year period. It is assumed that the PLM software will 
be used 230 days per year making the daily cost of PLM software $3,913. This cost will 
be distributed equally across all processes of phases IV and V of SHIPMAIN. 


3. Reengineered Processes 


The SHIPMAIN process was reengineered by adding 3D laser scanning tools and 
a comprehensive suite of PLM products to the as-is state. Implementation of 3D laser 
scanning tools will primarily affect block 265.1 by enabling the planning yard to acquire 
images and output their drawings in a highly accurate and electronically transferable 3D 


format as opposed to static installation drawings delivered on paper. The 3D scanning 
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tools can produce a 2D output also as currently required under the FMP. With the 
addition of a robust PLM product suite, the 3D images generated can be shared across the 
enterprise in an Integrated Data Environment allowing all stakeholders real-time access 


to highly accurate as-built imagery through a single interface. 


Implementation of an enterprise-wide PLM product suite demonstrated a 
remarkable effect on each core process. Providing stakeholders access to real-time 
information related to all iterations of the product lifecycle in a collaborative environment 
enabled nearly all sub-processes to benefit. Processes that didn’t demonstrate a 
quantitative improvement in this model will likely show qualitative improvements which 
will be discussed in the Conclusions section. Table 13 depicts the change in cost and 
ROI factors from the as-is to the to-be scenario. The majority of the estimates contained 


in this table were derived from interviews with SMEs from NAVSEA and SIS and a 


comprehensive review of the business rules listed in appendix D of the SCEPM dated 11 


December 2006. 





















: 


ock 265} Hull Installation and Risk Assessment | $130,060,112 $63,437,554 $66,622,558 155% 
ock 270 Authorize Installation $3,161,600 $3,217,805 ($56,205) 682% 668% 
0} Resolve "Not Authorized/Deferred SC $619,424 $427,964 $191,460 498% | 766% 


ies) 


Install SC $40,616,160 $33,433,420 $7,182,740 133% | 183% 


Feedback: Cost, CM, Performance, 
Schedule, ILS $619,424 $242,107 $377,317 199% 665% 


Block 320 Continue Installs $3,068,520 $2,510,944 $557,576 131% 
Block 330 Final Install, Closeout SC $309,712 $304,059 | $5,653 =| 199% | 205% 


Totals:} $183,766,200 | $105,861,524 


Table 13. As-Is and To-Be Cost and ROI Value Differences 


Authorize and Issue Letter of 
Block 250] Authorization (LOA)/Hull Maintenance 
Plan (HMP); Generate 2Ks $5,311,248 $2,287,671 $3,023,577 326% | 565% 





The results shown in Table 13 demonstrate that despite the additional expense of 
acquiring 3D laser scanning and PLM tools, the overall cost would be reduced by nearly 
$78 million dollars in this scenario. It is apparent that cost savings are achieved in all 
processes, with the exception of block 270, as a result of 3D laser scanning and PLM 
tools. As the technologies mature and work processes are modified to maximize their 


potential, cost savings and ROI should continue to improve over time. 
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4. To-Be Data Analysis 


Reengineering the to-be scenario proved to be quite challenging. While the 
formal guidance for SHIPMAIN is relatively mature for phases I-III, that is not so for 
phases [TV and V. Remarkable effort has been put into developing and refining the 
business rules associated with phases IV and V and they continue to be in a maturing 
phase at the time of this study. According to one SME, the processes currently in use to 
accomplish the tasks in phases IV and V are the legacy procedures until all areas become 
aligned with the business rules and the required technology to support them is acquired. 
As the business rules, governance structure and core technologies mature, the processes 
as defined in current SHIPMAIN business rules should become the standard practice. In 
order to model the notional to-be scenario, strict observation of currently defined 
business rules were coupled with SME assessments of their practical implementation for 
each core process. For additional clarity, all core processes will be described in terms of 
their sub-processes and the assumptions affecting key parameter changes from the as-is to 


the to-be scenario. 
a. Block 250 To-Be KVA Analysis 


Table 14 shows all KVA estimates used to determine the total process 
benefits, annual cost and ROI of the notional to-be revision of block 250. Assumptions 
for block 250 are as follows: 


e The PLM product suite would provide the means for processes identified 
in the business rules as “future enhancements” to become a reality. 


e A conservative estimate of 20 percent greater efficiency was applied to the 
times fired per year for blocks 250.1 and 205.3 due to automation. 


Block 250 
Authorize and Issue Letter of Authorization (LOA)/Hull Maintenance Plan (HMP); Generate 2Ks 





Hourly Time to 
Personnel | Head | Times Perf.| Complete Annual Total 

Sub process Cost count | Per Year (Hrs) Personnel Cost | _ IT Cost ALT (Hrs)| Knowledge | Total Benefits Annual Cost ROK 
z Create AHMP/EHMP $42.45 0 720 1 $0 $56,250 Yo 28800 $2,138,395 $56,250] 3802%| 
250.2 _|Create Annual HMP/LOA $42.45 1 1200 40 $2,037,678 _ |$56,250 Yo 153600 $11,404,776 $2,093,928] 545% 
250.3 {Initiate 2Ks into ICMP $35.70 1 624 1 $22,276 $56,250 Yo. 19968 $1,482,621 $78,526| 1888%| 
250.x _|Generate/issue QISM $42.45 2 4 8 $2,717 $56,250 Yo 2560 $190,080 $58,967] 322% 
Process Totals: $15,215,872 $2,287,671 


Table 14. KVA Analysis of To-Be for Block 250 
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The business rules for block 250.1 and 250.3 identify that their processes 
will become automated and the output will be auto-generated as a “future enhancement” 
(Commander, Naval Sea Systems Command, 2006, p. 67). Accordingly the values for 
head count, times fired per year, time to complete and percent IT were adjusted to reflect 


the effects of automation. 


Block 250.2 does not realize any quantitative changes with the 
implementation of 3D laser scanning or PLM. However, the accuracy of the outputs 
from this block will potentially become much higher with the PLM suite. PLM tools 
provide some benefit to block 250.x though centralization of required inputs necessary to 
accomplish the task, reducing the number of personnel involved and the time to complete 


the process. 


b. Block 265 To-Be KVA Analysis 


Table 15 shows all KVA estimates used to determine the total process 
benefits, annual cost and ROI of the notional to-be revision of block 265. Assumptions 
for block 265 are as follows: 

e There are 17 unique tasks involved in block 265.1 


e The 15 employees required for the ship check task of block 265.1 don’t 
use the entire time allotted to complete the process. The 15 ship check 
employees are notionally reallocated to remaining tasks of a similar pay 


grade. 
e Two additional employees are required to accomplish the 17 tasks. 
e Cycle time will improve by a conservative estimate of 20 percent with the 


addition of PLM and 3D laser scanning. PLM will allow suppliers and 
purchasers to share requirements and plan for delivery in a real-time 
Integrated Data Environment. 3D laser scanning will provide more 
accurate design parameters to suppliers than hand drawn images reducing 
the amount of “field engineering” required. 
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Block 265 
Hull Installation and Risk Assessment 


iy ime to 
Personnel | Head | Times Perf.| Complete Annual Total 
Sub process Cost count | Per Year (Hrs) Personnel Cost | _ IT Cost ALT (Hrs)| Knowledge | Total Benefits Annual Cost ROK ROI 








Installation Procurement, Design & 
[Advance Planning $43.10 leg 624 128 $58,527,196 [$219,402 7 40 1697280 |$126,022,772 _|$58,746,598 215%  |115% 
Hull Installation Readiness Review $29.78 2 520 32 $991,238 $56,250 40 277333 _|$20,591,956 $1,047,488 1966% |1866% 
Evaluate Maturity Status $50.16 1 520 20 $521,696 $56,250 %o 40 20800 _|$1,544,397 $577,946 267% |167% 
Provide Risk Assessment $50.16 1 520 40 $1,043,391 $56,250 %o 56 29120 _|$2,162,155 $1,099,641 197% _|97% 















































Formally Propose Install for 
265.4.1|Readniess Assessment and Auth. $50.16 $626,035 $56,250 %o 124800 _|$9,266,380 $682,285 1358% |1258% 
265.5 |Risk/Readiness Determination $59.01 $1,227,347 — [$56,250 Yo 29120 |$2,162,155 $1,283,597 168% [68% 


Process Totals: $161,749,816 $63,437,554| 255% 





Table 15. KVA Analysis of To-Be for Block 265 


Block 265.1 is directly affected by the introduction of 3D laser scanning 
and PLM technologies and the cost for each is shared by this process. Using 
Komorosky’s findings (2005) related to the planning yard process to accomplish a ship 
check; personnel involved for ship check would be reduced by at least 50 percent and 
cycle time would improve by at least 20 percent. However, ship check is one of many 
tasks involved in 265.1. There are 17 individual tasks which make up block 265.1 
leading Subject Matter Experts to rank it as the most complex process involved 
throughout phases IV and V of the SHIPMAIN process. Using a baseline of 15 
employees required for ship check, which will be notionally reallocated upon completion 
of the task, two additional employees would be required to accomplish the 17 tasks of 


block 265.1. 


Blocks 265.2 through 265.5 are primarily processes that involve decision 
makers evaluating available information on readiness, risk, maturity and systems 
integration to determine if a proposed installation should be approved for actual 
installation. For CSI installations, a quarterly meeting is held to discuss the issues for 
pending installations and all stakeholders travel to a central location to discuss the issues 
in person (Anonymous, personal communication, May 2007). The majority of the inputs 
for decision makers are generated by systems and processes which exist in the as-is 
scenario. Introducing a PLM suite would not have much effect on the quantitative items 
measured in this study. However, it would allow all stakeholders to conduct their 
meeting in a virtual setting with all of them having access to the same information in real- 
time thereby eliminating travel expenses and lost productivity due to travel time. Using a 


conservative estimate that each decision maker brings a support staff of at least five to 
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each meeting and the cost per traveler is $1,800, the annual expense for travel alone 
would be $352,000. While that value is not reflected in the to-be model as a cost, it is 


worth mentioning. 
c. Block 280 To-Be KVA Analysis 


Table 16 shows all KVA estimates used to determine the total process 


benefits, annual cost and ROI of the notional to-be revision of block 280. 


Block 280 
Resolve * "Not Authorized/Deferred SC" 


Time 
oe net | Head | Times Pert.| cor sae 
Sub process Cost | count| Per Year (Hrs) | Personi pee torte IT Cost a ALT (Hrs)| Kno Suen Total Benefits Annual Cost 


Update HMP,LOA and Fielding Plan | $29.78 | 1 | 520 | 24 |Sa7i,7i4 [80% 49920 $3,706,552 $427,964] _866%| 766% 


Table 16. .KVA Analysis of To-Be for Block 280 





This process updates key planning and authorization documents after 
installation review in block 265 and Fleet Commander or platform specific TYCOM 
authorization in block 270. The process will become more efficient when it is 
accomplished with PLM tools because the personnel involved will have access to all 
documents and process owners in a collaborative environment. To account for the 


increased efficiency, cycle time was reduced by two days. 
d. Block 300 To-Be KVA Analysis 


Table 17 shows all KVA estimates used to determine the total process 
benefits, annual cost and ROI of the notional to-be revision of block 300. Assumptions 
for block 300 are as follows: 


e The majority of management and verification tasks will be accomplished 
by 30 percent fewer staff due to collaboration and access to a common 
data environment provided by PLM. 


e Cycle time will improve by 20 percent due to: 
e Improved coordination between suppliers and the shipyards 
e Less rework due to installation items being built more accurately 


from the 3D imagery provided of as-built configuration. 


50 


Block 300 
Install SC 





Hourly 
Personnel | Head | Times Perf. Annual Total 
Sub process Cost | count| Per Year Personnel Cost | _ IT Cost aT ALT (Hrs)! Knowledge | Total Benefits Annual Cost 


(Complete installation and testing $42.45 36 624 $33,377,170 [$56,250 \%o 40 1275733 $94,722,998 $33,433,420| 283% 


Table 17. KVA Analysis of To-Be for Block 300 












































Block 300 is where the actual installation of SCs occur. Although the 
majority of the tasks involved are physically installing modifications, several oversight 
tasks will benefit from the introduction of PLM tools. Improved communication and 
coordination between material suppliers and shipyards through the PLM products will 
increase efficiency and minimize project delays. Also, 3D imagery from block 265 
shared with suppliers in real-time will enable delivery of higher quality and better 
performing “plant engineered” parts minimizing rework and reducing “field engineering” 


to accomplish the install. 


e. Block 310 To-Be KVA Analysis 


Table 18 shows all KVA estimates used to determine the total process 
benefits, annual cost and ROI of the notional to-be revision of block 310. Assumptions 
for block 310 are as follows: 


e PLM will enable a 50 percent reduction in staff by having all related 
information available through a single interface. 


e Time to complete the tasks will be reduced by 75 percent by eliminating 
lengthy manual data collection and aggregation. 


e The process will be executed 20 percent more often annually. 


Block 310 
Feedback: Cost, CM, Performance, Schedule, ILS 





Hourly Time to 
Personnel | Head | Times Perf.| Complete Annual 
Sub process Cost | count| Per Year (Hrs) | Personnel Cost | IT Cost aT — | ALT (Hrs) Total Benefits Annual Cost 


Provide Feedback Data $29.78 1 624 10 $185,857 $56,250 24 $1,853,276 $242,107] 765% 


Table 18. .KVA Analysis of To-Be for Block 310 












































There are six tasks contained in this block which lead to the final outputs. 
The process for collecting the required information to accomplish the tasks contained in 
block 310 is primarily manual. Introduction of a PLM product suite would allow a user 


to access all product information (cost, schedule, performance, CM and ILS) related to an 
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installation, a specific hull, or a class of hulls through a single interface and auto-generate 
pre-defined feedback reports. The feedback reports generated will be more reliable and 
output faster than those in the as-is model. Another key benefit of the PLM products is 
that each ship, system or class of ships will have complete lifecycle information 
documented in one place allowing leadership to truly understand the total cost of 


ownership for a hull, class or system. 
f Blocks 320 and 330 To-Be KVA Analysis 


Table 19 shows all KVA estimates used to determine the total process 


benefits, annual cost and ROI of the notional to-be revision of blocks 320 & 330. 


Block 320 
Continue Installs 





Hourly 
Personnel | Head | Times Perf. Annual Total 
Sub process Cost | count| Per Year Personnel Cost | IT Cost aT ALT (Hrs)! Knowledge | Total Benefits Annual Cost 


Continue Installs $59.01 5 520 $2,454,694 $56,250 20% 24 78000 $5,791,488 $2,510,944 
Block 330 


Final Install, Closeout SC 
Hourly Time to 

Personnel | Head | Times Perf.| Complete Annual Total 
Sub process Cost count] Per Year (Hrs) Personnel Cost IT Cost aT ALT (Hrs)} Knowledge Total Benefits Annual Cost 


Verify all SCs have been completed $29.78 1 520 16 $247,809 $56,250 Yo 24 12480 $926,638; $304,059| 305% 


Table 19. KVA Analysis of To-Be for Blocks 320 & 330 





















































Block 320 is a decision based process where risks from previous 
installations are evaluated and decisions are made to adjust the follow-on installation plan 
and if required, refine the Cost Benefit Analysis estimates. This process remains mainly 
a human thought process in the to-be scenario but it is supported by accurate and timely 
information available trough the PLM product. A conservative estimate of 20 percent 


less time to complete the task was applied. 


Block 330 is where planned installations are compared to installations 
reported as complete to determine if an SCD can be closed out. Verification that all ILS 
is completed and delivered also occurs. The to-be scenario introduces the PLM product 
which would place all verification items into a virtual environment accessible through a 


single interface leading to a 20 percent reduction in time to complete the task. 
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V. CONCLUSIONS AND RECOMMENDATIONS 


A. RESEARCH LIMITATIONS 


The KVA models in this study were generated primarily from data gathered by 
interviewing SMEs at NAVSEA and generalized across enterprise management and 
shipyard and activities. Therefore, the data contained in this research can’t be assumed to 
be perfect but it can be assumed to be reliable due to the high levels of correlation across 
key KVA data point of ordinal ranking, ALT and RLT. As stated earlier, phases IV and 
V of the SHIPMAIN process are not functionally in practice as described in formal 
business rules, legacy processes are still being used to accomplish the goals of phases IV 
and V. Therefore some disparity may exist between the realities of functional practice 
and the process as described in the business rules. Due to time constraints and the 
exceptionally large scope of phases IV and V of SHIPMAIN, the scope was limited to 
only the core processes and the first level of sub-processes. Several additional sub-layers 


could be modeled for higher levels of accuracy specific to a given community of interest. 


B. RESEARCH QUESTIONS 


Analysis of this study reveals the significant potential value that 3D laser 
scanning and PLM technologies have to offer maintenance and modernization efforts for 
U.S. Navy warships. High quality, reliable, accurate and reusable digital 3D data capture 
paired with the information storage, distribution and collaboration capabilities of PLM 
can provide a single digital thread connecting as-desired, as-planned, as-built and as- 
maintained product data throughout the lifecycle of any ship or program. This single 
digital environment has the potential to provide decision makers longitudinal views of a 
product from cradle to grave that they have never had before. However, it can’t be 
assumed that these technologies will provide optimal performance without a strategic 
policy to guide information management. Leadership must continually evaluate the 
overall environment and adapt to changing economic, political and technical 
environments without losing site of their strategic goals. Application of this KVA 


methodology to phases IV and V of the SHIPMAIN process has yielded one type of 
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decision support model to demonstrate the potential impact of 3D laser scanners 


and PLM technologies within this environment. 
1; Cost Savings 


Cost savings is the most apparent and profound benefit potentially offered by 3D 
data capture and PLM tools. The U.S. Navy currently spends nearly $184 million to 
accomplish the implementation and installation of 520 medium complexity ship changes 
to all surface combat vessels. This cost estimate is based solely on labor rates and 
doesn’t include expenses for travel or material. In the reengineered to-be scenario, this 
cost drops to less than $106 million; a remarkable reduction of 43 percent. Within the 
KVA analysis framework there are two distinct factors which account for the savings. 
The obvious reductions are accomplished by a reduction in manpower allowing the same 
number of jobs to be accomplished with fewer people. The less obvious is the ability of 
the decreased workforce to accomplish the same tasks at a faster rate. Regardless of 


which path is evaluated, the cost savings potential for this application is remarkable. 


Cost is only one factor to consider when evaluating ROI. An easy way create 
high ROI ratios is to simply cut costs, but cost cutting can potentially have a negative 
impact on the benefits or value provided by the process. The KVA analysis conducted on 
this case reveals that total benefits increased from $248 million to nearly $319 million; a 
substantial measure of 33 percent. As shown in Table 20, the decrease in cost coupled 
with an increase in benefits leads to an improved ROI ratio of 201 percent for the to-be 


model compared to the as-is model ROI ratio of 35 percent. 











Totals: | $183,766,200 | $248,101,392 | $105,861,524 | $318,820,901 
Table 20. As-Is and To-Be ROI Comparison 
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2. Fleet Cycle Time 


An improved fleet cycle time will provide Operational Commanders greater 
availability of their operational assets. If availability periods are reduced without 
reducing level of work accomplished, fleet cycle time could potentially improve. This 
study demonstrated that the cycle time for phases IV and V of SHIPMAIN would be 
reduced from 80 days to 56 days, a 2.5 week reduction in cycle time. 

If every operational Navy ship was available for one additional week of 

tasking, over a two year time-span, the DoN would have 280 additional 


weeks for tasking assignments, training, or crew rest and relaxation 
opportunities — (Komorosky, 2005, p. 60). 


3: Lifecycle Planning and Improved Business Process Efficiency 


According to a SME from NAVSEA (Anonymous, personal communication, May 
2007), the Navy doesn’t have a single portfolio that contains all product lifecycle 
information from cradle to grave for individual ships, classes of ships or shipboard 
systems. PLM tools have the potential to build a coherent data structure and consolidate 
dispersed information sources of as-designed, as-planned, as-built and as-maintained 
product data into a single record for specific ships, classes of ships or shipboard systems. 
Common access to a single repository of comprehensive lifecycle information will enable 
decision makers to conduct analysis and make informed decisions based on the full 


spectrum of product definition data. 


As the DoN continues to seek more efficient ways of doing business, Six Sigma 
initiatives are likely to be one of the primary tools used to drive change. However, the 
DON lacks necessary tools to acquire historical data necessary for Six Sigma initiatives to 
produce optimal results. Using PLM as a strategic business approach will provide 
decision makers access to product definition information across the enterprise in support 
of Six Sigma initiatives. An important relationship between Six Sigma and PLM is that 
they are both enterprise initiatives that focus on business value as the driver for change, 
not cost in isolation. Six Sigma initiatives supported by PLM have the potential to 
provide DoN leadership an effective and comprehensive means to accomplish desired 


enterprise business transformation. 
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C. REAL OPTIONS 


While this research is not specifically conducting a Real Options analysis, the 
technologies presented in this research can be implemented in many different ways 
including phased-in acquisitions, several up-front purchases, and ways to extend use of 


the technology to other areas. Several options scenarios are listed below: 


e Do nothing and allow the as-is process to continue. 

e Immediately acquire the 3D laser scanning capability for the public 
planning yards without PLM tools. If successful, expand to all planning 
yards. 

e Immediately acquire 3D laser scanners and PLM technologies for public 
the planning yards. If successful, expand implementation across all 
planning yards. 

e Immediately acquire comprehensive PLM software for all government 


agencies involved in Surface Fleet Modernization and Maintenance 
(SYSCOM, TYCOM, Fleet Commander, OPNAV, RMC, public 
shipyards, etc.) Once business rules are established and mature, extend 
PLM to all maintenance and modernization efforts (Submarine, Aircraft, 
Missiles, etc.) 


e Immediately acquire a minimal set of the PLM product suite for 
enterprise maintenance and modernization efforts. If successful, acquire 
additional functionality to support additional areas. 


D. RECOMMENDATIONS TO THE NAVY 


Continue efforts to standardize processes across all shipyards and supporting 
industrial activities. If the desired end state of initiatives like SHIPMAIN and the FMP 
are to improve processes through data sharing and standardization of business rules, it 
will be difficult to attain desired levels of interoperability without standardized processes. 
Also, stakeholders need to have access to, and a means to discuss, the most current and 


reliable information across the enterprise. 


Navy leadership must continually evaluate their vision, and the means they are 
using to implement it, in order to harness the power of modern technologies that increase 


in capability at an exponential rate. To stay competitive, Navy leadership must not allow 
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its vision to become static or rest on the success of past initiatives. They must maintain 
the momentum that initiatives like SHIPMAIN and the Fleet Modernization Plan have to 


continually improve their business processes. 


Measuring the success of program managers only by how well they meet cost, 
schedule and performance goals of their project is shortsighted. PMs must be held 
accountable, and rewarded, for how well they steer their programs to meet modern 
transformation initiatives like SHIPMAIN or open architecture (OA) and how their 
decisions affect the total lifecycle cost, not just the initial program objectives. Much 
more focus must be placed on providing the means for effectively managing the lifecycle 


of naval battle force assets. 


All IT investments involve substantial amounts of risk and the cost of IT tends to 
be front loaded. The technologies discussed in this research are not an exception to 
traditional risks associated with large scale IT initiatives. Navy leadership must 
adequately consider the amount of risk in proportion the potential value IT initiatives 
provide over time and continually strive to improve business processes so the maximum 
benefits of IT initiatives can be realized. Implementation of 3D laser scanning and PLM 
technologies would not result in immediate returns and the SHIPMAIN processes would 
require additional modification to optimize their potential. However, the value of 3D 
laser scanning and PLM technologies is not only outwardly intuitive, it is backed by the 
analytical methodology presented in this research and the respective ROI values 


associated with it. 


Conducting a study similar to NSRPs Ship Check Data Capture project with the 
introduction of PLM tools could demonstrate the actual benefits this technology pair can 
provide. This study was purely predictive in nature, conducting an actual field 
experiment with 3D laser scanning and PLM paired as a system could demonstrate far 


more of the capabilities and limitations of these technologies. 
E. FOLLOW ON AND FUTURE RESEARCH OPPORTUNITIES 


SHIPMAIN is a large program involving many personnel from several large 


organizations. This study took a top-level view at phases IV and V of the SHIPMAIN 
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process and how 3D laser scanning and PLM tools could potentially affect the ROK and 
ROI. There may be value added for specific communities of interest in conducting 
additional research on specific blocks of the SHIPMAIN program down to the lowest 
level of decomposition. Additionally, specific processes of the SHIPMAIN program 
should be evaluated to compare the current state to a notional state after the introduction 
of PLM products. The cost estimation process would be a prime target for such an 
evaluation and establishing contact with NAVSEA 017 would help in this effort. Other 
potential processes for evaluation are material procurement, post installation testing and 


lifecycle management. 
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APPENDIX A: KVA+RO METHODOLOGY 


A. KVA+RO!” 


The Naval Postgraduate School (NPS) developed the Knowledge Value 
Added/Real Options (KVA+RO) valuation framework which quantifies elements of 
uncertainty and risks and includes ways to mitigate these risks through strategic options. 
KVA+RO analysis is designed to support IT portfolio acquisitions and to empower 
decision-makers by providing performance-based data and scenario analysis (Komorosky 
et al., 2006). Analyses like Return on Investment (ROD) on individual projects, programs 
and processes within a portfolio of IT acquisitions can be derived through KVA 
methodology. With historical data provided by KVA, potential strategic investments can 
then be evaluated with Real Options analysis. The analysis applied is a robust and 
analytical process incorporating the risk identification (applying various sensitivity 
techniques), risk quantification (applying Monte Carlo simulation), risk valuation (Real 
Options analysis), risk mitigation (Real Options framing), and risk diversification 


(analytical portfolio optimization). 
B. THE VALUE PROBLEM!8 


Before investigating the potential returns or benefits knowledge assets, either 
human or IT, can provide, one must understand the concept of “value.” When new and 
promising IT resources are introduced into an organization, the value derived may take a 
variety of intangible forms, such as improved market competitiveness, expanded markets, 
new capabilities, or increased efficiency. What value an organization receives from that 
IT asset depends on many factors beyond the entire capability of the asset, such as 
organizational culture, the management climate, and the organization’s commitment to 
training and maintenance. Also important to note is the percentage of the IT resource’s 


full potential that is actually in use. If the asset is rarely used or used at baseline 


17 This entire section is taken directly from (Komorosky et al., 2006) 
18 Sections B-D are taken directly from (Komorosky, 2005) 
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functionality, then the perceived and actual value derived from the IT asset is likely low. 
Leveraging people, technologies, and information effectively within an organization can 


promote team cohesion and provides value. 


In other definitions of value, financial metrics tend to prevail. In fact, most value 
assessments focus on return and cost of ownership for IT investments. Monetary benefits 
are determined in commercial applications by assigning a price per unit to each process 
output. However, these financial-based methods seldom capture the benefit streams 
produced by processes and resources in common, comparable units of measurement. At 
the same time, financial metrics and benefits are difficult to apply in private-sector and 
government organizations. The DoD, for example, will not be able to establish the 
monetary benefits, or the value added from combat effectiveness, operational readiness, 
and national defense. Therefore, an alternate common unit must be used to determine the 


value added in public-sector process analysis. 
C3 THE KVA SOLUTION 


The Knowledge Value-Added (KVA) methodology provides a framework for the 
analytical analysis of organizational knowledge assets. Developed by Drs. Thomas 
Housel (Naval Postgraduate School) and Valerny Kanevsky (Agilent Lab), the theory of 
KVA has been published internationally, and has been applied in academic research and 
20 various business consultations for over 15 years. Executed properly, KVA will 
measure the value of knowledge embedded in an organization’s core processes, 
employees, and IT investments. This measure is quantified in a return-on-knowledge 
(ROK) ratio, which can be used to identify how much value knowledge assets provide 
within each core business process. In instances where revenue comparisons or other 
market-comparable values are available, a return on investment (ROI) figure can be 


ascertained. 
1 The Theory of KVA 


With its roots in the Information Age, the theory behind KVA follows the basic 
principles of thermodynamics by purporting that organizational outputs can be described 


in units of complexity. More specifically, KVA theory is based on the concept of 
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entropy, which connotes changes in the environment. It follows that as all organizations 
collect input from various sources and add value in some way, the inputs are transformed 
to outputs, and the value added during that transition is proportionate to the amount of 
transformation necessary to change the inputs to the desired output. A unit of change, 
therefore, is considered simply as a unit of complexity. Belief in this assertion provides a 
method by which all organizational outputs can be measured in common units. The value 
added to each process comes from organizational knowledge assets: people, processes, 
capabilities, or information technology. Through estimation of this value, an analytical 
method for estimating the return on knowledge, using the knowledge inherent in 
organizational assets to describe process outputs with a common unit of measurement, is 


achieved. 


The knowledge used every day in the core processes of an organization can be 
translated to a numerical format, because knowledge is a surrogate for the process outputs 
measured in common units. By capturing corporate knowledge into value, with clear 
figures to measure the value contained in each process, decision and policy makers can 
reengineer processes to maximize value. Then, by seeing the returns each process 
generates, better decisions can be made for an organization. Whether the knowledge is 
contained in IT systems or in the minds of an organization’s employees is irrelevant, 
because common units of knowledge can be observed in the organization’s core 
processes, and measured in terms of cost. Similarly, this approach provides management 
a verifiable way to assign benefit streams and costs to sub-organizational outputs 
produced by its knowledge assets, and can effectively redirect management’s investment 


focus from cost containment to value creation. 


Figure 4, below, shows a visual depiction of the KVA methodology’s underlying 


model and primary assumptions. 
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Fundamental Assumptions of KVA 


Underlying Model: Change, Knowledge and Value are Proportionate 


Input Process Output 
X ( p Y 


PUX) = ¥ 
Fundamental Assumptions: 
1. If X=Y, no value has been added. 


2. “Value” is proportional to change. 


3. “Change” can be measured by the amount of 
knowledge required to make the change. 


So “value” is proportional to “change” is 
proportional to “amount of knowledge required 
to make the change. 





Figure 16. Assumptions of KVA (Housel & Bell 2004) 


The assumptions presented in Figure 16 are the foundation of the KVA process. 
Accepting these assumptions allows the methodology to work in a way that breaks all 
input down into a common unit of output, allowing all processes to be evaluated from a 
common baseline reference. Because of this, how data is collected, analyzed, and how 
easily it can be monetized, the methodology functions much like accounting. As such, 


KVA results can be utilized in corporate finance and valuation problems. 
2 Core Process Identification 


In order to translate the knowledge utilized in an organization’s core processes to 
numerical form, it is important to accurately define what those core processes are, and to 
define the amount of change each process produces. Typically, corporate executives or 
other Subject Matter Experts are able to identify the main processes executed by their 
organization. In some instances, work flow models exist and may be referenced. In most 


instances, five to seven core processes sufficiently cover the core processes executed by 
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an organization. For each of those processes, boundaries must be established by 
identifying the end output of the process, including all subprocess outputs that eventually 


create the end product. Any contribution IT provides to the process must be isolated. 
3. Approaches to KVA 


The knowledge within a process can be represented as learning time, process 
instructions, or information bits. In theory, any approach that satisfies the basic KVA 
assumptions will create the same results; however, it must capture the “know-how” in the 
production of process outputs, given particular inputs. Table 21 illustrates the steps used 
in three primary methods used to apply KVA. The Binary Query Method will not be 


addressed in this research. 


TABLE 7.1 THREE APPROACHES TO KVA 


Steps Learning time Process description Binary query method 


1 Identify core process and its subprocesses. 


2. Establish common units to Describe the products in terms of Create a set of binary yesino 
measure learning time the instructions required to questions such that all possible 

reproduce them and select unit of outputs are represented as a 

process description sequence of yes/no answers 


Calculate learning time to Calculate number of process Calculate length of sequence of 
execute each subprocess. instructions pertaining to each yes/no answers for each 
subprocess. subprocess 


Designate sampling time period long enough to capture 4 representative sample of the core process's 
final product/service output. 


Multiply the learning time for each Multiply the number of process Multiply the length of the yes/no string 
subprocess by the number of times instructions used to describe each for each subprocess by the number of 
the subprocess executes during subprocess by the number of times _— times this subprocess executes during 
sample period the subprocess executes during sample period. 

sample period. 


Allocate revenue to subprocesses in proportion to the quantities generated by step 5 and calculate costs for each 
subprocess. 


Calculate ROK, and interpret the results 





Table 21. | Three Approaches to KVA (Housel & Bell, 2001) 


a. Learning Time Approach 


In the learning time approach, the amount of knowledge embedded in a 


core process is represented by an estimate of the amount of time it would take an 
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individual of average ability to learn that process’s execution well enough to successfully 
create the same process output. In capturing this estimate, learning time is proportional 
to the amount of knowledge learned, and thus indicates how much knowledge is 
embedded in that process. In the context of this methodology, this figure is called 
“Actual Learning Time,” or ALT. Learning Time must be measured in common units of 
time, and these units represent common units of output, which are described by the 
variable K. Following this line of thought, a single execution of any process is equal to a 


single unit of output, represented by a given number of common units, K. 


The obvious question, then, is how one correctly estimates how long it 
would take for an average person to learn a certain process. In practice, most Subject 
Matter Experts can provide quality estimates based on formal training times, on-the-job 
training, training manuals, and other programs, given a minimum explanation of what 
ALT is in terms of the KVA methodology. It is important that SMEs understand that for 
each estimate, knowledge must only be counted when it is in use; otherwise, there is a 
tendency to overestimate the amount of knowledge contained in a given process. Further, 
knowledge must only be counted if it is truly necessary to execute the process. The 
shortest, most succinct approach to the process output must be considered, again, to avoid 


overestimation. 
b. Establishing Reliability 


Critics would argue that the Learning Time Approach is subjective and 
anecdotal. However, several methods exist to ensure reliability and confidence of all 
estimates. The most common way of ensuring reliable estimates is by calculating the 
correlation between the ALT, ordinal ranking, and relative learn time (RLT) for each 
process. A correlation value greater than or equal to 80% is sufficient for establishing 
reliability, and is the preferred method of proving the estimates credible. The three terms 
are described in detail below: 


e Actual Learn Time (ALT) is an estimate for the period of time it would 
take to teach an average individual to execute a given process. There is no 
limit to the amount of time required. 


e Ordinal Rank is a measure of process complexity described as its 
difficulty to learn. Subject Matter Experts, or Executives within an 
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organization are asked to rank the processes in order from that which is 
easiest to learn, to that which is the most difficult to learn. 


e Relative Learn Time (RLT) is a measure of the time it would take to teach 
an average individual the core processes of an organization given only 100 
hours, days, months, or other unit of time. 


Subject Matter Experts or Executives must allocate the time appropriately 
to each process, with regard to that process’s complexity. Estimates may also be verified 
using actual knowledge measures such as on-the-job training time, or the number of 
process instructions within each core process. However, attaining a high degree of 
correlation and reliability between ALT, RLT, and Ordinal Rankings is the preferred 
method (Housel & Bell, 2001). 


c. Total Learning Time 


The amount of knowledge embedded into the existing IT used in each core 
process must be captured. This estimate is best achieved by considering what percentage 
of a process is automated. This percentage estimate for IT is used to calculate the total 
learning time (TLT), and revenue is allocated proportionally. Interestingly, the revenue 
attributed to IT-based knowledge, plus the cost to use that IT, often reveals that the value 
added to processes by IT applications, shown in the resulting ROK ratio, is not always 


equal to the percentage of IT and automation used in a process (Housel & Bell, 2001). 
d. Process Instructions Approach 


In some cases, the Process Instruction Approach must be used to gain 
reliability of estimates. This approach requires Subject Matter Experts to truly break 
apart each core process into the various subtasks that comprise it, in order to describe the 
products in terms of the “instructions required to reproduce them.” By capturing the 
actual learning time of the subprocesses, one is better able to assign reliable estimates of 
the knowledge contained therein. Just as the case in the Learning Time Approach, it is 
important that the estimates cited in Process Instructions only contain the knowledge 
required, or “in use” during execution of each individual process, without overlap. By 
adding the ALT results for each subprocess within a core process, one has a more reliable 


estimate of the core process’s ALT. 
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4. Measuring Utility and Knowledge Executions 


A count must be taken to determine the number of times the knowledge is 
executed (value) and the time is takes to execute (cost) in a given sample period. These 
values are needed to determine the ROK value. The actual time is takes to execute the 
process, multiplied by cost, is a flow-based estimate of its cost. It is important to note 
that process costs alone, without reference to value, present a different picture of the core 


process’s value. 


5. The Relevance of Return on Knowledge (ROK) 


The return ratio known as ROK is expressed with a numerator representing the 
percentage of revenue allocated to amount of knowledge required to complete a given 
process successfully, in proportion to the total amount of knowledge required to generate 
the total outputs. The denominator of the equation represents the cost to execute the 
process knowledge. With knowledge as a surrogate for the process outputs measured in 
common units, a higher ROK signifies better utilization of knowledge assets. In this way, 
KVA makes is possible to measure how well a specific process is doing in converting 
existing knowledge into value. Similarly, it gives decision-makers an idea of how an 
investment in knowledge and learning is paying off, and not simply how much it costs. 
The ROK value provides decision makers an analytical way to determine how knowledge 
can be more effectively used to produce better return on performance. If increased 
automation does not improve the ROK value of a given process, steps must be taken to 


improve that process’s function and performance. 


D. REAL OPTIONS 


Real Options Analysis is a market-based methodology invented to address the 
investment challenges faced by corporations in the modern day economy. It suggests that 
corporate valuation depends less on traditional fundamentals, and more on future 
expectations. The traditional discounted cash flow analysis methods: the income, cost, or 
market approach, tend to view risk and return on investment in a static view. Dr. 


Johnathan Mun, an expert in Real Options Theory, and credited with making it 
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operational in practice, theorizes that not all risk is bad; in fact, upside risk can often be 
advantageous. Upside risk is defined simply as the opportunities that coincide with the 
threats for any given risk. Dr. Mun’s interpretation of Real Options is often described as 
“anew way of thinking,” and he views capital investments in terms of a dynamic 
approach, since all decision making processes have generic and dynamic options 
associated with them. Real Options Analysis is done by considering these real options, 


then using options theory to evaluate physical, vice financial assets. 


Dr. Mun identifies eight phases in the real options process framework. The first 
phase begins with the qualification of projects through management screening, which 
eliminates all but those projects management wants to evaluate. The second phase starts 
with the construction of a discounted cash flow model under the base case condition. 
Next, Monte Carlo simulation is applied, and the results are inserted in the real options 
analysis. This phase covers the identification of strategic options that exist for a 
particular project under review. Based on the type of problem framed, the relevant real 
options models are chosen and executed. Depending on the number of projects as well as 
management set constraints, portfolio optimization is performed. The efficient allocation 
of resources is the outcome of this analysis. The next phase involves creating reports and 
explaining to management the analytical results. This step is critical in that an analytical 
process is only as good as its expositional ease. Finally, the last phase involves updating 
the analysis over time (Mun, 2002). Real options analysis adds tremendous value to 
projects with uncertainty, but when uncertainty becomes resolved through the passage of 
time, old assumptions and forecasts have now become historical facts. Therefore, 
existing models must be updated to reflect new facts and data. This continual 
improvement and monitoring is vital in making clear, precise, and definitive decisions 


over time. 
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APPENDIX B: THE FIVE PHASES OF SHIPMAIN 


There are five phases leading to the completion of an alteration/modification. 
These five phases are: conceptual, preliminary design, detailed design, implementation 


and installation. 
A. PHASE I - CONCEPTUAL 


The purpose of this phase is to identify a need for change, propose a resolution, 
and gain approval to proceed with development of that resolution into an engineered Ship 
Change (SC). Products developed during this phase include: 

° Requirement and proposed conceptual solution. 


° Proposed fielding plan. 


e Estimate for Phase II and III design development. 
e “Best Guess” estimate for Phase IV and V implementation and 
execution. 
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Figure 17. Phase I Top Level Flow Chart (Commander, Naval Sea Systems Command, 
2006) 
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B. PHASE II - PRELIMINARY DESIGN 


The purpose of this phase is to initiate design work for the SC, perform 


preliminary design development of the SC, and gain approval to continue to detailed 


design. Preliminary design development can include selection of technologies, 


establishment of design parameters, and prototype development. Products developed 


during this phase can include: 


Design parameters. 
Updated fielding plan. 
Refined estimates for Phases III, IV, and V. 


Initiation of Installation Control Drawings (ICDs) and performance 
specifications. 


Identification of interfaces and distributive system impacts. 
Design Budget Execution Plans. 
Prototype Design. 





Ef 
re 


Figure 18. Phase II Top Level Flow Chart (Commander, Naval Sea Systems Command, 


2006) 
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C. PHASE ITA 


Upon approval at Decision Point (DP) 1, the approving authority may determine a 
SC is eligible to move through Phase Ila. Phase Ia is utilized when a proposed SC 
design is mature to the point that DP 2 is not required. Phase Ila is a combination of the 
Phase II and HI development and review processes and ends at DP 3. In order to qualify 


for Phase IIa, the following criteria must be met: 


If the scope of the SC is an Internal Equipment Modification, all of the following 





criteria must be met: 


® The SC can be accomplished without changing an interface 
external to the equipment or system. 

e The change is made within the equipment or system. 

e The change does not negatively impact Strike Force 


Interoperability (SFI) 


e The change does not impact shipboard distributive systems, Ship 
Selected Records (SSRs) or interfacing equipment or systems, 
compartmental arrangement records, or Damage Control records. 


If the scope of the SC is a Ship Modification, all of the following requirements 


must be met: 


e The change does not negatively impact SFI. 

® The change does not impact ship stability records (weight & 
moment). 

e The change does not impact or alter the 3-dimensional footprint of 


the equipment being replaced. 


e The change does not impact shipboard distributive systems, SSRs 
or interfacing equipment or systems, compartmental arrangement 
records, or Damage Control records. 


e The change does not impact manning levels. 


Installation may not begin until authorized in Phase IV. 
D. PHASE III- DETAILED DESIGN 


The purpose of this phase is to complete detailed design development of the SC. 
Once approved at DP 3, SCs are added to the Authorized or Planned but Not Authorized 
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section of the Ship Program Manager (SPM) Letter of Authorization (LOA). 
Installations may not begin in Phase IV until they have been added to the Authorized 
Section of the SPM LOA in accordance with the milestones identified. The Technical 
Data Package (TDP) for a Ship Change Document (SCD) at DP 3 must include the level 
of detail equivalent to preliminary class-level Ship Installation Drawings (SIDs) or 
preliminary ICDs. Products developed during this phase can include: 


e A Technical Data Package. 


e Installation Control Drawings. 
° Performance Specifications. 
e Quantification of interfaces and distributive system impacts (i.e. 


parametric data). 
e Refined estimates for Phases IV and V. 
e Refined fielding plan. 


e List of required certifications and Plan of Action and Milestones 
(POA&M) for completion. 


e Alteration Bill of Material (ABOM) including Long Lead Time 
Material (LLTM),Government Furnished Equipment (GFE), and 
logistically significant material 3-4. 
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Figure 19. Phase III Top Level Flow Chart (Commander, Naval Sea Systems Command, 
2006) 
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E. PHASE IV- IMPLEMENTATION 


The purpose of Phase IV is to accomplish site-specific advanced planning of the 
SC. The attention is redirected from overall SC applicability to design for installation on 
a specific hull or at a specific location. This phase includes finalized design (including 
Ship Check/site survey, drawings, technical installation instructions, etc.), initiation of 
procurement, pre-installation certification and testing, installation readiness assessments, 


and risk assessments. Products developed during Phase IV can include: 


e Ships Installation Drawings 

e ILS Certification. 

e Government Furnished Equipment (GFE) and Industrial Activity 
Furnished (IAF) material procurement. 

e Pre-installation certifications. 

e Pre-installation testing. 

® Risk assessments. 

e Installation documents. 

@ Alteration Installation Team (AIT) Plan of Action and Milestones 
(POA&M). 


Funding for Phase IV is budgeted as part of the Modernization Plan (MP) after 
Phase Ia or III approval. 


1. SCD Revision 


There are currently two reasons to have a SCD revised, post DP 3. The first is 
capability difference between what was planned for procurement and what was actually 
procured. This capability difference includes changes inherent through design, provided 
by the manufacturer, for a multi-year procurement requirement. The second is if SCD 
actual costs are projected to increase by a factor greater than +/- 10% more than 


estimated costs, a revised SCD must be resubmitted to DP 3. 
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Figure 20. Phase IV Top Level Flow Chart (Commander, Naval Sea Systems Command, 
2006) 


F. PHASE V- INSTALLATION 


The purpose of Phase V is to execute the SC and provide feedback for future 
installation decisions. It is possible for a SC to be in Phase IV and V in parallel for 
different individual installations. Feedback from each individual installation is provided 
to update and refine technical information and installation cost estimates. Once all 
planned installations have been completed, this phase and the SC are closed out by 
providing feedback data reflecting final installation and closeout. Products developed 
and services performed during Phase V can include: 

e Return Cost Reports. 

° Liaison Action Requests (LARs). 

e Post-installation certification and testing. 
° ILS Product delivery. 


e Alteration Completion Reports. 
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Figure 21. Phase V Top Level Flow Chart (Commander, Naval Sea Systems Command, 
2006) 
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APPENDIX C. 2005 NSRP SHIP CHECK COST/TIME SAVINGS 


Labor Expense Labor Expense 
Cost Cost Cost Cost 


Total Number of 2 3 

Design Personnel 

Estimated labor cost 
perhour $50 





Number of hours for 
ship check 


Total expense days 











Estimated Travel 
Expense: 

Airfare $400 
Lodging $125 
Car Rental $45 
Per Diem $43 





Scanner/Software 
Investment & ($500) 
Maintenance 
































Table 22. Traditional vs. Laser Scanning Small Ship Check (National Shipbuilding 
Research Program Advanced Shipbuilding Enterprise, 2006) 


Total Number of 
Design Personnel 











Estimated Travel 
Expense: 
Airfare $400 
Lodging $125 
Car Rental $45 
Per Diem $43 


$14,620 





Scanner/Software 
Investment & ($2000) 
Maintenance 


Total Cost/Time a $16.800 $9,665 


Table 23. Traditional vs. Laser Scanning Large Ship Check (National Shipbuilding 
Research Program Advanced Shipbuilding Enterprise, 2006) 
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APPENDIX D: BUSINESS RULES FOR PHASES IV AND V 


A. BLOCK 250 


Goal/Description: Develop Hull Modernization Plan (HMP), and associated time- 
phased Advanced Planning HMP (AHMP) and Execution Planning HMP (EHMP), issue 
Letter of Authorization (LOA), and generate/update 2Ks to reflect decisions made by the 
appropriate Voting Boards and depicted in the MP. 


Sub-Tasks: 

® 250.1 Develop AHMP/EHMP. 
e 250.2 Develop HMP. 

e 250.3 Generate/Update 2K. 


e SCD and specific NDE-NM data elements (covered in BR 250.2), 
scheduled to an applicable hull as reflected in the MP. 


° CSI Baseline Status as discussed in BR 250.2 for Strike Force 
Interoperability (SFI) CAT 1 and 2. 


e Legacy Alteration (D, K, Engineering Changes) JCF and SAR approval 
status. 


Output: 


Time Phased, Critical Milestone based NDE-NM reports: 

e AHMP/EHMP and associated Advance Planning Letter (APL). 
e HMP/LOA. 

e 2Ks. 


B. BLOCK 265 


Goal/Description: Complete all required design, procurement of material, pre- 





installation testing, and obtain all required certifications/risk assessment(s) prior to final 
installation. Evaluate maturity of an installation and determine if the SC is ready for 
installation. Perform a risk assessment for SCs that have not achieved maturity IAW the 


milestone charts to determine whether or not to proceed with installation planning. 
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Sub-Tasks: 


265.1 Installation Procurement, Design & Advanced Planning. 
265.2 Hull Installation Readiness Review. 

265.3 Installation Maturity Determination. 

265.4 Hull Installation Risk Assessment. 

265.5 Operational Risk/Readiness Determination. 


265.xx (Future Enhancement) Generate Readiness Assessment Form. 


SCs approved at DP 2 for Non Permanent Change (NPC) installations or 
DP 3 (Phase Ila/III) for permanent installations. 


AHMP/HMP/LOA. 
Completed readiness assessment form (Future Enhancement). 


Documentation of completed milestones entered in appropriate 
authoritative data sources. 


Installation risk(s), if any. 


Output: Installation recommendation based on maturity and installation risk. 


C. BLOCK 270 


Goal/Description: Authorize the installation of an SC on a specific hull based 


upon the installation readiness assessment, installation risk assessment (as applicable), 


and operational risk. After authorization, installation can be moved to the authorized 


portion of the HMP/LOA. If an installation is disapproved, that item shall be removed 


from the HMP/LOA. If the disapproval will cause a change in the SCD funding profile, 


the PARM must update the SCD and resubmit it to the boards for approval. 


Sub-Tasks: 


Installation decision. 


Installation recommendation. 
Endorsements from ESG/CSG staff. 
Endorsements from Numbered Fleet staff. 


For C5I SFI Cat 1 and 2, endorsement from Platform TYCOM. 
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Output: 
e Approval for installation. 

e Update of HMP/LOA. 
e Disapproval of installation and removal. 


e Issue Updated LOA/Quarterly Scheduling Message IAW Block 250. 
D. BLOCK 280 


Goal/Description: Update HMP, Letter of Authorization and Fielding Plan (if 
required) and reschedule in NDE-NM. 


Sub-Tasks: 

e Update Mod Plan (if required). 

e SC rescheduling in NDE-NM. 

e Update HMP/LOA/Quarterly Installation Scheduling Message (QISM). 


Input: Disapproval and/or deferral of Installation. 
Output: 


e Updated HMP/LOA. 


e Updated SCD for submission to the O-6 Board at DP 3 (if required [AW 
the Fielding Plan change process in section 3 of the SSCEPM). 


E. BLOCK 300 


Goal/Description: Complete installation and testing [AW drawings and other 
technical guidance and deliver all Integrated Logistic Support (ILS) products. 


Sub-Tasks: 
e SC Check in (for AIT installs). 
e Installation of SC. 
e Provide government oversight of AIT (as required). 


« Provide RMC/NSA Installation. 
e Progress Reports. 
e Testing of SC. 
e Delivery of ILS. 
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Validation of installation and ILS delivery. 
e Final SSRs and SRDs typically delivered 3 months post-install. 


Release completion message. 


Authorized SC and supporting documentation to support installation and 
checkout of specific installations. 


Installation Readiness Assessment. 

Installation POA&M and MOA (for AIT jobs). 

Installation QA Plan. 

CDMD-OA COP Data submission. 

ILS Certification Sheets. 

PY Approved Drawings and ship-specific Bill of Material (BOM). 


Output: 


Installed SC 


Completion Reports (IAW NAVSEAINST 4790.14 series, JEMM, 
Appendix H, and SSCEPM Section 6). 


CDM Planned/Emergent Installation Reports. 
Ship availability ILSMT Action Items. 
Completion message. 


Closed out 4790/2Ks and 4790/CKs (IAW NAVSEAINST 4790.8 series). 


F. BLOCK 310 


Goal/Description: Provide feedback data to support future installation decisions 


and (if necessary) revise portions of the Ship Change (SC). 


Sub-Tasks: 

e Provide feedback. 
e Cost. 
e Configuration Management (CM). 
e Schedule. 


e Testing/Integrated Logistics support (ILS). 
° Technical Feedback. 
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e Schedule (Completion Date). 


e System Performance/QA. 
e HSI Fleet Certification. 
Input: 
e Completed Installation. 


e Completion Report (AW NAVSEAINST 4790.14 series, JEMM, 
Appendix H, and SSCEPM Section 6). 


e Closed out 4790/2Ks and 4790/CKs TAW NAVSEAINST 4790.8 series). 
e Closed out RMMCO check-out form for AITs. 


Output: 

e Completed SC with actual Return Cost, CM and Testing/ILS. 
e NSA EOA/EOI Reports. 

e Ship ILSMT Minutes/Action Items. 

e HSI Fleet Certification Message. 


G. BLOCK 320 


Goal/Description: Using feedback information from completed installs, determine 


impact on follow-on installs. 


Sub-Tasks: 

e Assess risk based on information from initial/follow-on installation. 

e Decide whether to adjust follow-on installation plan. 

e If required, refine CBA estimates. 

Input: 

e Updated Cost, Configuration Management (CM), Integrated Logistics 


Support (ILS), Technical, Material, and Schedule data from initial and/or 
follow-on installation. 


e LARs or other design configuration changes/updates. 
e Ships Superintendent Reports. 

e Completion Reports. 

e Ships Situation Reports. 
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Output: 


e Participating Acquisition Resource Manager (PARM)/Resource Sponsor 
dialog on whether to continue follow-on installs (if required). 


e If necessary, revised Ship Change (SC) to reflect changes to cost, material, 
fielding plan, etc. 


H. BLOCK 330 
Goal/Description: Verify all planned installations of the Ship Change (SC) have 
been completed. 
Sub-Tasks: Determine that all planned installations have been completed. 
Input: Mature SC and supporting installation completion documentation. 


Output: 


e Determination that all planned installations are complete. 


Close out of SC in the MP. 


88 


INITIAL DISTRIBUTION LIST 


Defense Technical Information Center 
Ft. Belvoir, Virginia 


Dudley Knox Library 


Naval Postgraduate School 
Monterey, California 


89 


